Jul 05 05:03:13 devstack cinder-volume[75410]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 05:03:13 devstack cinder-volume[75410]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 05:03:13 devstack cinder-volume[75410]: we strongly recommend against using it for new projects. Jul 05 05:03:13 devstack cinder-volume[75410]: If you are already using Eventlet, we recommend migrating to a different Jul 05 05:03:13 devstack cinder-volume[75410]: framework. For more detail see Jul 05 05:03:13 devstack cinder-volume[75410]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 05:03:13 devstack cinder-volume[75410]: import eventlet # noqa Jul 05 05:03:16 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 05:03:16 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 05:03:16 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 05:03:17 devstack cinder-volume[75410]: INFO dbcounter [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Registered counter for database cinder Jul 05 05:03:17 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG dbcounter [-] [75410] Writer thread running {{(pid=75410) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 05:03:18 devstack cinder-volume[75410]: INFO cinder.rpc [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 05:03:18 devstack cinder-volume[75410]: INFO cinder.rpc [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:03:18 devstack cinder-volume[75410]: INFO cinder.volume.manager [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Determined volume DB was empty at startup. Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG cinder.volume.manager [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75410) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 05:03:18 devstack cinder-volume[75410]: INFO cinder.volume.manager [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 05:03:18 devstack cinder-volume[75410]: WARNING stevedore.named [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 05:03:18 devstack cinder-volume[75410]: WARNING castellan.key_manager [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 05:03:18 devstack cinder-volume[75410]: WARNING cinder.keymgr.conf_key_mgr [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG cinder.volume.drivers.lvm [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75410) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_concurrency.processutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_concurrency.processutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] CMD "cinder-rtstool verify" returned: 0 in 0.387s {{(pid=75410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:03:18 devstack cinder-volume[75410]: INFO cinder.rpc [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 05 05:03:18 devstack cinder-volume[75410]: INFO cinder.rpc [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 05 05:03:18 devstack cinder-volume[75410]: WARNING stevedore.named [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 05:03:18 devstack cinder-volume[75410]: WARNING castellan.key_manager [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 05:03:18 devstack cinder-volume[75410]: INFO cinder.volume.manager [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:03:18 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Starting 1 workers Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Started child 75605 {{(pid=75410) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Full set of CONF: {{(pid=75410) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] ******************************************************************************** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Configuration options gathered from: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] ================================================================================ {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] allow_availability_zone_fallback = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] allow_compression_on_image_upload = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] allowed_direct_url_schemes = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] api_rate_limit = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] auth_strategy = keystone {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] az_cache_duration = 3600 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75605]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_availability_zone = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_host = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_stats_polling_interval = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backup_api_class = cinder.backup.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backup_name_template = backup-%s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backup_use_same_host = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backup_use_temp_snapshot = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] chap_password = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] chap_username = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_internal_tenant_project_id = 64f961c498df4446a08e3f4f2229110a {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_internal_tenant_user_id = d316d38832e245f7aff452066c772e9a {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cloned_volume_same_az = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cluster = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] compression_format = gzip {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] compute_api_class = cinder.compute.nova.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] config_dir = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] config_source = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] control_exchange = openstack {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] debug = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] default_availability_zone = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] default_group_type = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] default_volume_type = lvmdriver-1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] disk_geometry = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] driver_client_cert = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] driver_client_cert_key = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] driver_data_namespace = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] driver_ssl_cert_path = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] driver_ssl_cert_verify = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] driver_use_ssl = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] enable_force_upload = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] enable_new_services = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] enable_unsupported_driver = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] enabled_backends = ['lvmdriver-1'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] enforce_multipath_for_image_xfer = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] filter_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_api_insecure = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_api_ssl_compression = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_ca_certificates_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_catalog_info = image:glance:publicURL {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_num_retries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance_request_timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] goodness_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] graceful_shutdown_timeout = 5 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] group_api_class = cinder.group.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] host = devstack {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_compress_on_upload = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_conversion_address_space_limit = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_conversion_cpu_limit = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_conversion_disable = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_upload_use_cinder_backend = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_upload_use_internal_tenant = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_volume_cache_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_volume_cache_max_count = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] image_volume_cache_max_size_gb = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] init_host_max_objects_retrieval = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] instance_format = [instance: %(uuid)s] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] iscsi_target_flags = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] iscsi_write_cache = on {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] iser_helper = tgtadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] iser_ip_address = 192.168.122.178 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] iser_port = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_color = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_config_append = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75605]: INFO cinder.volume.manager [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 05 05:03:18 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_dir = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_options = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_rotate_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_rotate_interval_type = days {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] log_rotation_type = none {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] max_age = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] max_logfile_count = 30 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] max_logfile_size_mb = 200 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] max_over_subscription_ratio = 20.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] message_reap_interval = 86400 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] message_ttl = 2592000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] migration_create_volume_timeout_secs = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] monkey_patch = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] monkey_patch_modules = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] my_ip = 192.168.122.178 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] no_snapshot_gb_quota = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] num_iser_scan_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] num_shell_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] num_volume_device_scan_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] nvmeof_conn_info_version = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] nvmet_ns_id = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] nvmet_port_id = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] osapi_max_limit = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] osapi_volume_ext_list = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] osapi_volume_listen = 0.0.0.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] osapi_volume_listen_port = 8776 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] osapi_volume_use_ssl = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] osapi_volume_workers = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] per_volume_size_limit = -1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] periodic_fuzzy_delay = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] periodic_interval = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] project_id_regex = [0-9a-f\-]+ {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] public_endpoint = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] publish_errors = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] quota_backup_gigabytes = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] quota_backups = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] quota_gigabytes = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] quota_groups = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] quota_snapshots = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] quota_volumes = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] rate_limit_burst = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] rate_limit_except_level = CRITICAL {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] rate_limit_interval = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] reinit_driver_count = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] replication_device = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] report_discard_supported = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] report_interval = 120 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] reservation_clean_interval = 86400 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] reservation_expire = 86400 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] reserved_image_namespaces = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] reserved_percentage = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] rpc_response_timeout = 120 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] run_external_periodic_tasks = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] scst_target_driver = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] scst_target_iqn_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_down_time = 720 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] shell_completion = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] snapshot_name_template = snapshot-%s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] snapshot_same_host = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] split_loggers = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] state_path = /opt/stack/data/cinder {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] storage_availability_zone = nova {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] storage_protocol = iSCSI {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] syslog_log_facility = LOG_USER {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] target_helper = lioadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] target_ip_address = 192.168.122.178 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] target_port = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] target_protocol = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] target_secondary_ip_addresses = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] trace_flags = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] transfer_api_class = cinder.transfer.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] transport_url = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] until_refresh = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] use_chap_auth = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] use_default_quota_class = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] use_journal = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] use_json = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] use_multipath_for_image_xfer = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] use_stderr = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] use_syslog = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] verify_glance_signatures = enabled {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_api_class = cinder.volume.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_backend_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_clear = zero {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_clear_ionice = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_clear_size = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_copy_bps_limit = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_dd_blocksize = 1M {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_name_template = volume-%s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_service_inithost_offload = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volume_usage_audit_period = month {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] zoning_mode = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_concurrency.disable_process_locking = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.auth_section = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.auth_type = password {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.auth_version = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.cache = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.include_service_catalog = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.insecure = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.interface = public {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_password = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcache_username = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:18 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.region_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.service_type = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.backend = dogpile.cache.null {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.backend_argument = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.backend_expiration_time = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.config_prefix = cache.oslo {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.debug_cache_backend = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.enable_retry_client = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.enable_socket_keepalive = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.expiration_time = 600 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.hashclient_retry_attempts = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.memcache_dead_retry = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.memcache_pool_maxsize = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.memcache_sasl_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.password = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.proxies = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.redis_db = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.redis_server = localhost:6379 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.retry_attempts = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.retry_delay = 0.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.socket_keepalive_count = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.socket_keepalive_idle = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.socket_keepalive_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.socket_timeout = 1.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.tls_allowed_ciphers = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.tls_cafile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.tls_certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.tls_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.tls_keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cache.username = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] coordination.backend_url = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.asyncio_connection = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.asyncio_slave_connection = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.backend = sqlalchemy {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.connection = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.connection_debug = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.connection_parameters = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.connection_recycle_time = 3600 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.connection_trace = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.db_inc_retry_interval = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.db_max_retries = 20 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.db_max_retry_interval = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.db_retry_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.max_overflow = 50 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.max_pool_size = 5 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.max_retries = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.mysql_wsrep_sync_wait = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.pool_timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.retry_interval = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.slave_connection = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.sqlite_synchronous = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.synchronous_reader = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] database.use_db_reconnect = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.connection_string = messaging:// {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.es_doc_type = notification {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.es_scroll_size = 10000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.es_scroll_time = 2m {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.filter_error_trace = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.hmac_keys = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.sentinel_service_name = mymaster {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.socket_timeout = 0.1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.trace_requests = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler.trace_sqlalchemy = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler_jaeger.process_tags = {} {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler_jaeger.service_name_prefix = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] profiler_otlp.service_name_prefix = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.enforce_new_defaults = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.enforce_scope = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.policy_default_rule = default {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.policy_file = policy.yaml {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_policy.remote_timeout = 60.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] privsep_osbrick.group = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] privsep_osbrick.helper_command = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] privsep_osbrick.user = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_sys_admin.group = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_sys_admin.helper_command = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] cinder_sys_admin.user = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.auth_section = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.auth_type = password {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.cafile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.collect_timing = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.insecure = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.send_service_user_token = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.split_loggers = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] service_user.timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.auth_section = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.auth_type = password {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.collect_timing = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.insecure = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.region_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.split_loggers = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] glance.timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.backend_availability_zone = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.chap_password = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.chap_username = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.disk_geometry = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.driver_client_cert = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.driver_client_cert_key = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.driver_data_namespace = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.driver_use_ssl = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.extra_capabilities = {} {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.filter_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.goodness_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.iscsi_target_flags = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.iscsi_write_cache = on {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.iser_helper = tgtadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.iser_port = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.lvm_mirrors = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.lvm_share_target = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.lvm_type = auto {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.num_shell_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.replication_device = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.report_discard_supported = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.reserved_percentage = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.target_helper = tgtadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.target_port = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.target_protocol = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.trace_flags = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.unique_fqdn_network = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.use_chap_auth = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_backend_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack sudo[75610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_clear = zero {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_clear_ionice = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_clear_size = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack sudo[75610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volume_group = cinder-volumes {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_reports.file_event_handler = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_reports.log_dir = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.backend_host = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.chap_password = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.chap_username = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.chiscsi_conf = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.disk_geometry = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.driver_client_cert = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.driver_use_ssl = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.extra_capabilities = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.filter_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.goodness_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.iser_helper = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.iser_ip_address = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.iser_port = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.lvm_conf_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.lvm_mirrors = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.lvm_share_target = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.lvm_type = auto {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.num_shell_tries = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.nvmet_port_id = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.replication_device = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.report_discard_supported = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.reserved_percentage = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.scst_target_driver = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.storage_protocol = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.target_helper = lioadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.target_ip_address = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.target_port = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.target_protocol = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.trace_flags = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.use_chap_auth = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_clear = zero {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_clear_size = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] lvmdriver-1.volumes_dir = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.ssl = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.ssl_version = {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_notifications.driver = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_notifications.retry = -1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] key_manager.fixed_key = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.barbican_api_version = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.barbican_endpoint = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.barbican_endpoint_type = public {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.barbican_region_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.cafile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.collect_timing = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.insecure = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.number_of_retries = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.retry_delay = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.send_service_user_token = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.split_loggers = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.verify_ssl = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican.verify_ssl_path = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.auth_section = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.auth_type = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.cafile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.collect_timing = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.insecure = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.split_loggers = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] barbican_service_user.timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.approle_role_id = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.approle_secret_id = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.kv_mountpoint = secret {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.kv_path = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.kv_version = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.namespace = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.root_token_id = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.ssl_ca_crt_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.timeout = 60.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.use_ssl = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:03:19 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] ******************************************************************************** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 05:03:19 devstack sudo[75610]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:19 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:19 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:19 devstack sudo[75769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:19 devstack sudo[75769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:20 devstack sudo[75769]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:20 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.712s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:20 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:03:20 devstack cinder-volume[75605]: INFO cinder.brick.local_dev.lvm [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 05 05:03:20 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:20 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:20 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:20 devstack sudo[75997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:03:20 devstack sudo[75997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:21 devstack sudo[75997]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:21 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:21 devstack cinder-volume[75605]: DEBUG cinder.brick.local_dev.lvm [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75605) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 05 05:03:21 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:21 devstack sudo[76177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:21 devstack sudo[76177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:22 devstack sudo[76177]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:22 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.133s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:22 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:22 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:22 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:22 devstack sudo[76354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:22 devstack sudo[76354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:23 devstack sudo[76354]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:23 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.703s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:23 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:23 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:23 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:23 devstack sudo[76389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 05 05:03:23 devstack sudo[76389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:23 devstack sudo[76389]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:23 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.712s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:23 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:23 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:03:23 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:24 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:24 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.787s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:24 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:24 devstack sudo[76404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:03:24 devstack sudo[76404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:25 devstack sudo[76404]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:25 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.879s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:25 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:25 devstack sudo[76409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:03:25 devstack sudo[76409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:26 devstack sudo[76409]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:26 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.804s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:26 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:26 devstack sudo[76419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:26 devstack sudo[76419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:27 devstack sudo[76419]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.683s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:27 devstack sudo[76423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:27 devstack sudo[76423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:27 devstack sudo[76423]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:27 devstack cinder-volume[75605]: INFO cinder.volume.drivers.lvm [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:27 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:27 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:27 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:28 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:28 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.741s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:28 devstack cinder-volume[75605]: DEBUG cinder.volume.drivers.lvm [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Updating volume stats {{(pid=75605) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 05:03:28 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:28 devstack sudo[76551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:03:28 devstack sudo[76551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:28 devstack cinder-volume[75410]: DEBUG dbcounter [-] [75410] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75410) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:03:29 devstack sudo[76551]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:29 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:29 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:29 devstack sudo[76692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:03:29 devstack sudo[76692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:29 devstack sudo[76692]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:29 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:29 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:29 devstack sudo[76695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:29 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:30 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:30 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:30 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:30 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:03:30 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:31 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:31 devstack cinder-volume[75605]: INFO cinder.volume.driver [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG cinder.volume.driver [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75605) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG oslo_db.sqlalchemy.engines [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75605) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG dbcounter [-] [75605] Writer thread running {{(pid=75605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG cinder.db.api [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Building query based on filter {{(pid=75605) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG cinder.image.image_utils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75605) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 05:03:31 devstack cinder-volume[75605]: INFO cinder.keymgr.migration [None req-58dce46e-3735-4a8e-9540-ef5439f86b0e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG cinder.volume.drivers.lvm [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Updating volume stats {{(pid=75605) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:31 devstack sudo[76703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:03:31 devstack sudo[76703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:31 devstack sudo[76703]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:31 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:31 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:03:31 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:32 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:32 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:32 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:32 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:32 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:33 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:33 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:33 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:33 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:03:33 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:33 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:33 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:33 devstack cinder-volume[75605]: DEBUG cinder.manager [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Notifying Schedulers of capabilities ... {{(pid=75605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:03:33 devstack cinder-volume[75605]: INFO cinder.volume.manager [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Driver initialization completed successfully. Jul 05 05:03:33 devstack cinder-volume[75605]: INFO cinder.manager [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Initiating service 2 cleanup Jul 05 05:03:33 devstack cinder-volume[75605]: INFO cinder.manager [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Service 2 cleanup completed. Jul 05 05:03:33 devstack cinder-volume[75605]: DEBUG cinder.service [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Creating RPC server for service cinder-volume {{(pid=75605) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 05:03:33 devstack cinder-volume[75605]: DEBUG cinder.service [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75605) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 05:03:34 devstack cinder-volume[75605]: INFO cinder.volume.manager [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 05 05:03:34 devstack cinder-volume[75605]: DEBUG cinder.volume.drivers.lvm [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Updating volume stats {{(pid=75605) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 05:03:34 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:34 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:03:34 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:34 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:34 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.745s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:34 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:34 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:03:34 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:35 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:35 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:35 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:35 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:03:35 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:36 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:36 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:36 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:03:36 devstack sudo[76786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:03:36 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:03:36 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root Jul 05 05:03:36 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:03:36 devstack cinder-volume[75605]: INFO cinder.volume.manager [None req-bb9f41b6-5771-45f7-ba87-d33427d427d7 None None] Driver post RPC initialization completed successfully. Jul 05 05:03:43 devstack cinder-volume[75605]: DEBUG dbcounter [-] [75605] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:03:46 devstack cinder-volume[75605]: DEBUG dbcounter [-] [75605] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:03:54 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager._thread_info {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:03:54 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread count: 6 {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:03:54 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread info: [<_MainThread(MainThread, started 132475017949312)>, , , , , ] {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:04:54 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:04:54 devstack cinder-volume[75605]: DEBUG cinder.volume.drivers.lvm [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Updating volume stats {{(pid=75605) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 05:04:54 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:04:54 devstack sudo[79098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:04:54 devstack sudo[79098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:04:55 devstack sudo[79098]: pam_unix(sudo:session): session closed for user root Jul 05 05:04:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:04:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:04:55 devstack sudo[79111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:04:55 devstack sudo[79111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:04:56 devstack sudo[79111]: pam_unix(sudo:session): session closed for user root Jul 05 05:04:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:04:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:04:56 devstack sudo[79114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:04:56 devstack sudo[79114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:04:56 devstack sudo[79114]: pam_unix(sudo:session): session closed for user root Jul 05 05:04:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.644s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:04:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:04:56 devstack sudo[79117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:04:56 devstack sudo[79117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:04:57 devstack sudo[79117]: pam_unix(sudo:session): session closed for user root Jul 05 05:04:57 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:04:57 devstack cinder-volume[75605]: DEBUG cinder.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Notifying Schedulers of capabilities ... {{(pid=75605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:04:57 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager._thread_info {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:04:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread count: 6 {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:04:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread info: [<_MainThread(MainThread, started 132475017949312)>, , , , , ] {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:05:46 devstack cinder-volume[75605]: DEBUG dbcounter [-] [75605] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:05:54 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:05:54 devstack cinder-volume[75605]: DEBUG cinder.volume.drivers.lvm [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Updating volume stats {{(pid=75605) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 05:05:54 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:05:54 devstack sudo[82094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:05:54 devstack sudo[82094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:05:55 devstack sudo[82094]: pam_unix(sudo:session): session closed for user root Jul 05 05:05:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:05:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:05:55 devstack sudo[82099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:05:55 devstack sudo[82099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:05:56 devstack sudo[82099]: pam_unix(sudo:session): session closed for user root Jul 05 05:05:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:05:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:05:56 devstack sudo[82102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:05:56 devstack sudo[82102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:05:56 devstack sudo[82102]: pam_unix(sudo:session): session closed for user root Jul 05 05:05:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:05:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:05:56 devstack sudo[82278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:05:56 devstack sudo[82278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:05:57 devstack sudo[82278]: pam_unix(sudo:session): session closed for user root Jul 05 05:05:57 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:05:57 devstack cinder-volume[75605]: DEBUG cinder.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Notifying Schedulers of capabilities ... {{(pid=75605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:05:57 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager._thread_info {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:05:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread count: 6 {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:05:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread info: [<_MainThread(MainThread, started 132475017949312)>, , , , , ] {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:06:54 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:06:54 devstack cinder-volume[75605]: DEBUG cinder.volume.drivers.lvm [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Updating volume stats {{(pid=75605) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 05:06:54 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:06:54 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:06:54 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:06:55 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Jul 05 05:06:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:06:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:06:55 devstack sudo[84338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:06:55 devstack sudo[84338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:06:56 devstack sudo[84338]: pam_unix(sudo:session): session closed for user root Jul 05 05:06:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:06:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:06:56 devstack sudo[84341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:06:56 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:06:56 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root Jul 05 05:06:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:06:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:06:56 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:06:56 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:06:57 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Jul 05 05:06:57 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:06:57 devstack cinder-volume[75605]: DEBUG cinder.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Notifying Schedulers of capabilities ... {{(pid=75605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:06:57 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager._thread_info {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:06:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread count: 6 {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:06:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread info: [<_MainThread(MainThread, started 132475017949312)>, , , , , ] {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:07:46 devstack cinder-volume[75605]: DEBUG dbcounter [-] [75605] Writing DB stats cinder:SELECT=1 {{(pid=75605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:07:46 devstack cinder-volume[75605]: DEBUG dbcounter [-] [75605] Writing DB stats cinder:UPDATE=1 {{(pid=75605) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:07:54 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:07:54 devstack cinder-volume[75605]: DEBUG cinder.volume.drivers.lvm [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Updating volume stats {{(pid=75605) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 05:07:54 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:07:54 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 05:07:54 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:07:55 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Jul 05 05:07:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:07:55 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:07:55 devstack sudo[85604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:07:55 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:07:56 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root Jul 05 05:07:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:07:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:07:56 devstack sudo[85685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 05:07:56 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:07:56 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Caught SIGTERM, stopping children Jul 05 05:07:56 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Acquiring lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 05:07:56 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Acquired lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 05:07:56 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Releasing lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 05:07:56 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Stop services. {{(pid=75410) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 05:07:56 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Killing children. {{(pid=75410) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 05:07:56 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Waiting on 1 children to exit Jul 05 05:07:56 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root Jul 05 05:07:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:07:56 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:07:56 devstack sudo[85692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 05:07:56 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:07:57 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root Jul 05 05:07:57 devstack cinder-volume[75605]: DEBUG oslo_concurrency.processutils [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75605) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:07:57 devstack cinder-volume[75605]: DEBUG cinder.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Notifying Schedulers of capabilities ... {{(pid=75605) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:07:57 devstack cinder-volume[75605]: DEBUG oslo_service.periodic_task [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] Running periodic task VolumeManager._thread_info {{(pid=75605) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:07:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread count: 6 {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:07:57 devstack cinder-volume[75605]: DEBUG cinder.volume.manager [None req-14a5a2f5-e930-493e-a03d-cbf402f26e92 None None] thread info: [<_MainThread(MainThread, started 132475017949312)>, , , , , ] {{(pid=75605) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:07:59 devstack cinder-volume[75605]: DEBUG oslo_concurrency.lockutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Acquiring lock "singleton_lock" {{(pid=75605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 05:07:59 devstack cinder-volume[75605]: DEBUG oslo_concurrency.lockutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Acquired lock "singleton_lock" {{(pid=75605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 05:07:59 devstack cinder-volume[75605]: DEBUG oslo_concurrency.lockutils [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Releasing lock "singleton_lock" {{(pid=75605) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 05:07:59 devstack cinder-volume[75605]: WARNING amqp [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 05:07:59 devstack cinder-volume[75605]: WARNING amqp [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 05:07:59 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-75d317a3-0a1f-490d-8891-680878fe527b None None] Child 75605 exited with status 0 Jul 05 05:07:59 devstack cinder-volume[85697]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 05:07:59 devstack cinder-volume[85697]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 05:07:59 devstack cinder-volume[85697]: we strongly recommend against using it for new projects. Jul 05 05:07:59 devstack cinder-volume[85697]: If you are already using Eventlet, we recommend migrating to a different Jul 05 05:07:59 devstack cinder-volume[85697]: framework. For more detail see Jul 05 05:07:59 devstack cinder-volume[85697]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 05:07:59 devstack cinder-volume[85697]: import eventlet # noqa Jul 05 05:08:01 devstack cinder-volume[85697]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 05:08:01 devstack cinder-volume[85697]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 05:08:01 devstack cinder-volume[85697]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 05:08:02 devstack cinder-volume[85697]: INFO dbcounter [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Registered counter for database cinder Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_db.sqlalchemy.engines [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG dbcounter [-] [85697] Writer thread running {{(pid=85697) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 05:08:02 devstack cinder-volume[85697]: INFO cinder.rpc [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 05:08:02 devstack cinder-volume[85697]: INFO cinder.rpc [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_db.sqlalchemy.engines [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:02 devstack cinder-volume[85697]: INFO cinder.volume.manager [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Determined volume DB was empty at startup. Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG cinder.volume.manager [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85697) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 05:08:02 devstack cinder-volume[85697]: INFO cinder.volume.manager [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 05:08:02 devstack cinder-volume[85697]: WARNING stevedore.named [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 05:08:02 devstack cinder-volume[85697]: WARNING castellan.key_manager [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 05:08:02 devstack cinder-volume[85697]: WARNING cinder.keymgr.conf_key_mgr [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 05:08:02 devstack cinder-volume[85697]: INFO cinder.volume.manager [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_db.sqlalchemy.engines [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85697) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:02 devstack cinder-volume[85697]: INFO oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Starting 1 workers Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Started child 85913 {{(pid=85697) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Full set of CONF: {{(pid=85697) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] ******************************************************************************** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Configuration options gathered from: {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] ================================================================================ {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] allow_availability_zone_fallback = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] allow_compression_on_image_upload = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] allowed_direct_url_schemes = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] api_rate_limit = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] auth_strategy = keystone {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_availability_zone = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_host = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_stats_polling_interval = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backup_api_class = cinder.backup.api.API {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backup_name_template = backup-%s {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backup_use_same_host = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backup_use_temp_snapshot = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] chap_password = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] chap_username = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:02 devstack cinder-volume[85913]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_internal_tenant_project_id = 64f961c498df4446a08e3f4f2229110a {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_internal_tenant_user_id = d316d38832e245f7aff452066c772e9a {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cluster = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] compression_format = gzip {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] compute_api_class = cinder.compute.nova.API {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] config_dir = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] config_source = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] control_exchange = openstack {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] debug = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] default_availability_zone = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] default_group_type = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] default_volume_type = QuobyteHD {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] disk_geometry = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] driver_client_cert = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] driver_client_cert_key = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] driver_data_namespace = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] driver_ssl_cert_path = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] driver_ssl_cert_verify = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] driver_use_ssl = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] enable_new_services = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] enable_unsupported_driver = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] enabled_backends = ['QuobyteHD'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] enforce_multipath_for_image_xfer = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] filter_function = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_api_insecure = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_api_ssl_compression = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_ca_certificates_file = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_catalog_info = image:glance:publicURL {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_num_retries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance_request_timeout = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] goodness_function = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] graceful_shutdown_timeout = 5 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] group_api_class = cinder.group.api.API {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] host = devstack {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_compress_on_upload = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_conversion_address_space_limit = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_conversion_cpu_limit = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_conversion_disable = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_upload_use_cinder_backend = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_upload_use_internal_tenant = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_volume_cache_enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_volume_cache_max_count = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] image_volume_cache_max_size_gb = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] init_host_max_objects_retrieval = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] instance_format = [instance: %(uuid)s] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] iscsi_target_flags = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] iscsi_write_cache = on {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] iser_helper = tgtadm {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] iser_ip_address = 192.168.122.178 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] iser_port = 3260 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_color = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_config_append = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_dir = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_file = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_options = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_rotate_interval = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_rotate_interval_type = days {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] log_rotation_type = none {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] max_age = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] max_logfile_count = 30 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] max_logfile_size_mb = 200 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] max_over_subscription_ratio = 20.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] message_reap_interval = 86400 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] message_ttl = 2592000 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] migration_create_volume_timeout_secs = 300 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] monkey_patch = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] monkey_patch_modules = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] my_ip = 192.168.122.178 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] no_snapshot_gb_quota = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] num_iser_scan_tries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] num_shell_tries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] num_volume_device_scan_tries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] nvmeof_conn_info_version = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] nvmet_ns_id = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] nvmet_port_id = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] osapi_max_limit = 1000 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] osapi_volume_ext_list = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] osapi_volume_listen_port = 8776 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] osapi_volume_use_ssl = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] osapi_volume_workers = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] per_volume_size_limit = -1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] periodic_fuzzy_delay = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] periodic_interval = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] public_endpoint = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] publish_errors = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] quota_backup_gigabytes = 1000 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] quota_backups = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] quota_gigabytes = 1000 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] quota_groups = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] quota_snapshots = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] quota_volumes = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] rate_limit_burst = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] rate_limit_except_level = CRITICAL {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] rate_limit_interval = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] reinit_driver_count = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] replication_device = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] report_discard_supported = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] report_interval = 120 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] reservation_clean_interval = 86400 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] reservation_expire = 86400 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] reserved_image_namespaces = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] reserved_percentage = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] rpc_response_timeout = 120 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] run_external_periodic_tasks = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] scst_target_driver = iscsi {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] scst_target_iqn_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_down_time = 720 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] shell_completion = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85913]: INFO cinder.volume.manager [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] snapshot_name_template = snapshot-%s {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] split_loggers = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] state_path = /opt/stack/data/cinder {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] storage_availability_zone = nova {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] storage_protocol = iSCSI {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] syslog_log_facility = LOG_USER {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] target_helper = lioadm {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] target_ip_address = 192.168.122.178 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] target_port = 3260 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] target_protocol = iscsi {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] target_secondary_ip_addresses = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.remotefs [None req-071c0719-3239-4183-bb96-cd7076283659 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85913) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] trace_flags = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] transport_url = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] until_refresh = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] use_chap_auth = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] use_default_quota_class = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] use_journal = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] use_json = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] use_multipath_for_image_xfer = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] use_stderr = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] use_syslog = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] verify_glance_signatures = enabled {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_api_class = cinder.volume.api.API {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_backend_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_clear = zero {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_clear_ionice = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_clear_size = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_copy_bps_limit = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_dd_blocksize = 1M {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_name_template = volume-%s {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_service_inithost_offload = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volume_usage_audit_period = month {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] zoning_mode = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.auth_section = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.auth_type = password {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.auth_version = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.cache = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.include_service_catalog = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.insecure = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.interface = public {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_password = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcache_username = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.region_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.service_type = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.backend = dogpile.cache.null {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.backend_argument = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.backend_expiration_time = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.config_prefix = cache.oslo {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.debug_cache_backend = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.enable_retry_client = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.enable_socket_keepalive = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.expiration_time = 600 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.memcache_dead_retry = 300 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.memcache_pool_maxsize = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.memcache_sasl_enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.password = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.proxies = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.redis_db = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.redis_server = localhost:6379 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.retry_attempts = 2 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.retry_delay = 0.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.socket_keepalive_count = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.socket_keepalive_idle = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.socket_keepalive_interval = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.socket_timeout = 1.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.tls_allowed_ciphers = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.tls_cafile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.tls_certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.tls_enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.tls_keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cache.username = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] coordination.backend_url = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.asyncio_connection = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.asyncio_slave_connection = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.backend = sqlalchemy {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.connection = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.connection_debug = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.connection_parameters = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.connection_recycle_time = 3600 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.connection_trace = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.db_inc_retry_interval = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.db_max_retries = 20 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.db_max_retry_interval = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.db_retry_interval = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.max_overflow = 50 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.max_pool_size = 5 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.max_retries = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.pool_timeout = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.retry_interval = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.slave_connection = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.sqlite_synchronous = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.synchronous_reader = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] database.use_db_reconnect = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.connection_string = messaging:// {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.es_doc_type = notification {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.es_scroll_size = 10000 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.es_scroll_time = 2m {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.filter_error_trace = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.hmac_keys = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.sentinel_service_name = mymaster {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.socket_timeout = 0.1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.trace_requests = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler.trace_sqlalchemy = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler_jaeger.process_tags = {} {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] profiler_otlp.service_name_prefix = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.enforce_new_defaults = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.enforce_scope = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.policy_default_rule = default {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.policy_file = policy.yaml {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] privsep_osbrick.group = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] privsep_osbrick.helper_command = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] privsep_osbrick.user = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_sys_admin.group = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_sys_admin.helper_command = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] cinder_sys_admin.user = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.auth_section = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.auth_type = password {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.cafile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.collect_timing = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.insecure = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.send_service_user_token = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.split_loggers = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] service_user.timeout = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.auth_section = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.auth_type = password {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.collect_timing = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.insecure = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.region_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.split_loggers = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] glance.timeout = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.backend_availability_zone = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.chap_password = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.chap_username = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.disk_geometry = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.driver_client_cert = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.driver_client_cert_key = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.driver_data_namespace = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.driver_use_ssl = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.extra_capabilities = {} {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.filter_function = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.goodness_function = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.iscsi_target_flags = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.iscsi_write_cache = on {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.iser_helper = tgtadm {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.iser_port = 3260 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_host = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_login = admin {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_mount_options = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_password = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_private_key = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_share_path = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.num_shell_tries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.quobyte_volume_url = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.replication_device = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.report_discard_supported = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.reserved_percentage = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.target_helper = tgtadm {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.target_port = 3260 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.target_protocol = iscsi {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.trace_flags = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.unique_fqdn_network = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.use_chap_auth = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_backend_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_clear = zero {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_clear_ionice = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_clear_size = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_reports.file_event_handler = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_reports.log_dir = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.backend_availability_zone = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.backend_host = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.chap_password = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.chap_username = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.chiscsi_conf = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.disk_geometry = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.driver_client_cert = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.driver_data_namespace = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.driver_use_ssl = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.extra_capabilities = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.filter_function = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.goodness_function = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.iser_helper = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.iser_ip_address = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.iser_port = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.iser_target_prefix = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85913) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_host = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85913]: WARNING cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_login = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_mount_options = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_password = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85913]: WARNING cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_private_key = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_share_path = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Running cmd (subprocess): mount.quobyte {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_ssh_port = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.num_shell_tries = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.nvmet_port_id = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.replication_device = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.report_discard_supported = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.reserved_percentage = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.scst_target_driver = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.storage_protocol = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.target_helper = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.target_ip_address = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.target_port = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.target_prefix = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.target_protocol = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.trace_flags = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.use_chap_auth = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_clear = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_clear_size = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] QuobyteHD.volumes_dir = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.ssl = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_notifications.driver = [] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] key_manager.fixed_key = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.barbican_api_version = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.barbican_endpoint = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.barbican_endpoint_type = public {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.barbican_region_name = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.cafile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.collect_timing = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.insecure = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.number_of_retries = 60 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.retry_delay = 1 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.send_service_user_token = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.split_loggers = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.timeout = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.verify_ssl = True {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican.verify_ssl_path = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.auth_section = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.auth_type = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.cafile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.certfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.collect_timing = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.insecure = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.keyfile = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.split_loggers = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] barbican_service_user.timeout = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.approle_role_id = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.approle_secret_id = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.kv_mountpoint = secret {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.kv_path = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.kv_version = 2 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.namespace = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.root_token_id = **** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.ssl_ca_crt_file = None {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.timeout = 60.0 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.use_ssl = False {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:03 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] ******************************************************************************** {{(pid=85697) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 05:08:03 devstack quobyte-client[85918]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 05:08:03 devstack quobyte-client[85918]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=85913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:08:03 devstack cinder-volume[85913]: INFO cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 ... Jul 05 05:08:03 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f -c /etc/quobyte/client-cinder.cfg {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:03 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f -c /etc/quobyte/client-cinder.cfg Jul 05 05:08:03 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:04 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.745s {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:04 devstack cinder-volume[85913]: INFO cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 succeeded Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=85913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.759s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:04 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:08:04 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:04 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.629s {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:04 devstack cinder-volume[85913]: INFO cinder.volume.driver [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG cinder.volume.driver [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548027038574, 'free_capacity_gb': 1775.7548027038574, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85913) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_db.sqlalchemy.engines [None req-071c0719-3239-4183-bb96-cd7076283659 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85913) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG dbcounter [-] [85913] Writer thread running {{(pid=85913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG cinder.db.api [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Building query based on filter {{(pid=85913) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG cinder.image.image_utils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85913) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 05:08:04 devstack cinder-volume[85913]: INFO cinder.keymgr.migration [None req-b740352b-7745-40a7-a0ff-a87f265c7683 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=85913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=85913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:08:04 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:04 devstack sudo[85991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:08:04 devstack sudo[85991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:05 devstack sudo[85991]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.685s {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG cinder.manager [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Notifying Schedulers of capabilities ... {{(pid=85913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:08:05 devstack cinder-volume[85913]: INFO cinder.volume.manager [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Driver initialization completed successfully. Jul 05 05:08:05 devstack cinder-volume[85913]: INFO cinder.manager [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Initiating service 3 cleanup Jul 05 05:08:05 devstack cinder-volume[85913]: INFO cinder.manager [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Service 3 cleanup completed. Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG cinder.service [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Creating RPC server for service cinder-volume {{(pid=85913) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG cinder.service [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85913) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 05:08:05 devstack cinder-volume[85913]: INFO cinder.volume.manager [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=85913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=85913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:08:05 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:05 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:08:05 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:06 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:06 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-071c0719-3239-4183-bb96-cd7076283659 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.700s {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:06 devstack cinder-volume[85913]: INFO cinder.volume.manager [None req-071c0719-3239-4183-bb96-cd7076283659 None None] Driver post RPC initialization completed successfully. Jul 05 05:08:10 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:08:10 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:08:10 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=85913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:08:10 devstack cinder-volume[85913]: DEBUG cinder.volume.drivers.quobyte [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=85913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:08:10 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:08:10 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:10 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:08:10 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:11 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:11 devstack cinder-volume[85913]: DEBUG oslo_concurrency.processutils [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.720s {{(pid=85913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:11 devstack cinder-volume[85913]: DEBUG cinder.manager [None req-cf4ef19c-4e7a-46a1-bab0-145e67731954 None None] Notifying Schedulers of capabilities ... {{(pid=85913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:08:12 devstack cinder-volume[85697]: INFO oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Caught SIGTERM, stopping children Jul 05 05:08:12 devstack cinder-volume[85697]: DEBUG oslo_concurrency.lockutils [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Acquiring lock "singleton_lock" {{(pid=85697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 05:08:12 devstack cinder-volume[85697]: DEBUG oslo_concurrency.lockutils [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Acquired lock "singleton_lock" {{(pid=85697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 05:08:12 devstack cinder-volume[85697]: DEBUG oslo_concurrency.lockutils [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Releasing lock "singleton_lock" {{(pid=85697) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 05:08:12 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Stop services. {{(pid=85697) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 05:08:12 devstack cinder-volume[85697]: DEBUG oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Killing children. {{(pid=85697) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 05:08:12 devstack cinder-volume[85697]: INFO oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Waiting on 1 children to exit Jul 05 05:08:13 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Acquiring lock "singleton_lock" {{(pid=85913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 05:08:13 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Acquired lock "singleton_lock" {{(pid=85913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 05:08:13 devstack cinder-volume[85913]: DEBUG oslo_concurrency.lockutils [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Releasing lock "singleton_lock" {{(pid=85913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 05:08:13 devstack cinder-volume[85913]: WARNING amqp [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 05:08:13 devstack cinder-volume[85913]: WARNING amqp [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 05:08:13 devstack cinder-volume[85697]: INFO oslo_service.backend._eventlet.service [None req-15234baf-8189-46cf-8fab-8c1c2ff080b0 None None] Child 85913 exited with status 0 Jul 05 05:08:14 devstack cinder-volume[86325]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 05:08:14 devstack cinder-volume[86325]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 05:08:14 devstack cinder-volume[86325]: we strongly recommend against using it for new projects. Jul 05 05:08:14 devstack cinder-volume[86325]: If you are already using Eventlet, we recommend migrating to a different Jul 05 05:08:14 devstack cinder-volume[86325]: framework. For more detail see Jul 05 05:08:14 devstack cinder-volume[86325]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 05:08:14 devstack cinder-volume[86325]: import eventlet # noqa Jul 05 05:08:18 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 05:08:18 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 05:08:18 devstack cinder-volume[86325]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 05:08:19 devstack cinder-volume[86325]: INFO dbcounter [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Registered counter for database cinder Jul 05 05:08:19 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writer thread running {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 05:08:20 devstack cinder-volume[86325]: INFO cinder.rpc [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 05:08:20 devstack cinder-volume[86325]: INFO cinder.rpc [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:20 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Determined volume DB was empty at startup. Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG cinder.volume.manager [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86325) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 05:08:20 devstack cinder-volume[86325]: WARNING stevedore.named [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 05:08:20 devstack cinder-volume[86325]: WARNING castellan.key_manager [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 05:08:20 devstack cinder-volume[86325]: WARNING cinder.keymgr.conf_key_mgr [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 05:08:20 devstack cinder-volume[86325]: INFO cinder.volume.manager [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_db.sqlalchemy.engines [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:20 devstack cinder-volume[86325]: INFO oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Starting 1 workers Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Started child 86688 {{(pid=86325) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Full set of CONF: {{(pid=86325) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] ******************************************************************************** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] Configuration options gathered from: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] ================================================================================ {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] allow_availability_zone_fallback = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] allow_compression_on_image_upload = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] allowed_direct_url_schemes = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] api_rate_limit = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86688]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] auth_strategy = keystone {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_availability_zone = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_host = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_stats_polling_interval = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backup_api_class = cinder.backup.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backup_name_template = backup-%s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backup_use_same_host = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backup_use_temp_snapshot = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] chap_password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] chap_username = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_internal_tenant_project_id = 64f961c498df4446a08e3f4f2229110a {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_internal_tenant_user_id = d316d38832e245f7aff452066c772e9a {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cluster = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] compression_format = gzip {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] compute_api_class = cinder.compute.nova.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] config_dir = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] config_source = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] control_exchange = openstack {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] debug = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] default_availability_zone = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] default_group_type = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] default_volume_type = QuobyteHD {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] disk_geometry = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] driver_client_cert = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] driver_client_cert_key = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] driver_data_namespace = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] driver_ssl_cert_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] driver_ssl_cert_verify = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] driver_use_ssl = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] enable_new_services = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] enable_unsupported_driver = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] enabled_backends = ['QuobyteHD'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] enforce_multipath_for_image_xfer = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] filter_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_api_insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_api_servers = ['http://192.168.122.178/image'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_api_ssl_compression = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_ca_certificates_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_catalog_info = image:glance:publicURL {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_num_retries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance_request_timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] goodness_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] graceful_shutdown_timeout = 5 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] group_api_class = cinder.group.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] host = devstack {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_compress_on_upload = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_conversion_address_space_limit = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_conversion_cpu_limit = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_conversion_disable = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_upload_use_cinder_backend = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_upload_use_internal_tenant = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_volume_cache_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_volume_cache_max_count = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] image_volume_cache_max_size_gb = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] init_host_max_objects_retrieval = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] instance_format = [instance: %(uuid)s] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] iscsi_target_flags = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] iscsi_write_cache = on {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] iser_helper = tgtadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] iser_ip_address = 192.168.122.178 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] iser_port = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_color = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_config_append = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_dir = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_options = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_rotate_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_rotate_interval_type = days {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] log_rotation_type = none {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] max_age = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] max_logfile_count = 30 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:20 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] max_logfile_size_mb = 200 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86688) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] max_over_subscription_ratio = 20.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] message_reap_interval = 86400 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] message_ttl = 2592000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] migration_create_volume_timeout_secs = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] monkey_patch = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] monkey_patch_modules = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] my_ip = 192.168.122.178 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] no_snapshot_gb_quota = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] num_iser_scan_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] num_shell_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] num_volume_device_scan_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] nvmeof_conn_info_version = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] nvmet_ns_id = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] nvmet_port_id = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] osapi_max_limit = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] osapi_volume_ext_list = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] osapi_volume_listen_port = 8776 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] osapi_volume_use_ssl = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] osapi_volume_workers = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] per_volume_size_limit = -1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] periodic_fuzzy_delay = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] periodic_interval = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] public_endpoint = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] publish_errors = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] quota_backup_gigabytes = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] quota_backups = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] quota_gigabytes = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] quota_groups = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] quota_snapshots = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] quota_volumes = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] rate_limit_burst = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] rate_limit_except_level = CRITICAL {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] rate_limit_interval = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] reinit_driver_count = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] replication_device = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] report_discard_supported = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] report_interval = 120 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] reservation_clean_interval = 86400 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] reservation_expire = 86400 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] reserved_image_namespaces = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] reserved_percentage = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] rpc_response_timeout = 120 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] run_external_periodic_tasks = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] scst_target_driver = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] scst_target_iqn_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_down_time = 720 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] shell_completion = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] snapshot_name_template = snapshot-%s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] split_loggers = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] state_path = /opt/stack/data/cinder {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] storage_availability_zone = nova {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] storage_protocol = iSCSI {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] syslog_log_facility = LOG_USER {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] target_helper = lioadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] target_ip_address = 192.168.122.178 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] target_port = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] target_protocol = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] target_secondary_ip_addresses = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] trace_flags = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] transport_url = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] until_refresh = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] use_chap_auth = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] use_default_quota_class = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] use_journal = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] use_json = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] use_multipath_for_image_xfer = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] use_stderr = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] use_syslog = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] verify_glance_signatures = enabled {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_api_class = cinder.volume.api.API {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_backend_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_clear = zero {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_clear_ionice = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_clear_size = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_copy_bps_limit = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_dd_blocksize = 1M {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86688) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_name_template = volume-%s {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 05:08:21 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_service_inithost_offload = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volume_usage_audit_period = month {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] zoning_mode = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_concurrency.disable_process_locking = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Running cmd (subprocess): mount.quobyte {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.auth_section = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.auth_type = password {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.auth_version = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.cache = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.include_service_catalog = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.interface = public {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_password = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcache_username = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.region_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.service_type = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.178/identity {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.backend = dogpile.cache.null {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.backend_argument = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.backend_expiration_time = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.config_prefix = cache.oslo {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.debug_cache_backend = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.enable_retry_client = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.enable_socket_keepalive = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.expiration_time = 600 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.hashclient_retry_attempts = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.memcache_dead_retry = 300 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.memcache_pool_maxsize = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.memcache_sasl_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.proxies = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.redis_db = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.redis_server = localhost:6379 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.retry_attempts = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.retry_delay = 0.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.socket_keepalive_count = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.socket_keepalive_idle = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.socket_keepalive_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.socket_timeout = 1.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.tls_allowed_ciphers = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.tls_cafile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.tls_certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.tls_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.tls_keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cache.username = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] coordination.backend_url = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.asyncio_connection = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.asyncio_slave_connection = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.backend = sqlalchemy {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.connection = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.connection_debug = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.connection_parameters = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.connection_recycle_time = 3600 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.connection_trace = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.db_inc_retry_interval = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.db_max_retries = 20 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.db_max_retry_interval = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.db_retry_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.max_overflow = 50 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.max_pool_size = 5 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.max_retries = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.mysql_wsrep_sync_wait = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.pool_timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.retry_interval = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.slave_connection = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.sqlite_synchronous = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.synchronous_reader = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] database.use_db_reconnect = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.connection_string = messaging:// {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.es_doc_type = notification {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.es_scroll_size = 10000 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.es_scroll_time = 2m {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.filter_error_trace = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.hmac_keys = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.sentinel_service_name = mymaster {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.socket_timeout = 0.1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.trace_requests = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler.trace_sqlalchemy = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler_jaeger.process_tags = {} {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler_jaeger.service_name_prefix = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] profiler_otlp.service_name_prefix = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.enforce_new_defaults = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.enforce_scope = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.policy_default_rule = default {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.policy_file = policy.yaml {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] privsep_osbrick.group = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] privsep_osbrick.helper_command = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] privsep_osbrick.user = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_sys_admin.group = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_sys_admin.helper_command = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] cinder_sys_admin.user = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.auth_section = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.auth_type = password {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.cafile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.collect_timing = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.send_service_user_token = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.split_loggers = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] service_user.timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.auth_section = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.auth_type = password {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.collect_timing = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.region_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.split_loggers = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] glance.timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.backend_availability_zone = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.chap_password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.chap_username = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.disk_geometry = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.driver_client_cert = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.driver_client_cert_key = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.driver_data_namespace = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.driver_use_ssl = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.extra_capabilities = {} {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.filter_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.goodness_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.iscsi_target_flags = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.iscsi_write_cache = on {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.iser_helper = tgtadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.iser_ip_address = 192.168.122.178 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.iser_port = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_host = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_login = admin {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_mount_options = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_private_key = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_share_path = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.num_shell_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.quobyte_volume_url = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.replication_device = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.report_discard_supported = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.reserved_percentage = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.target_helper = tgtadm {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.target_ip_address = 192.168.122.178 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.target_port = 3260 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.target_protocol = iscsi {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.trace_flags = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.unique_fqdn_network = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.use_chap_auth = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_backend_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_clear = zero {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_clear_ionice = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_clear_size = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_reports.file_event_handler = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_reports.log_dir = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.backend_availability_zone = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.backend_host = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.chap_password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.chap_username = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.chiscsi_conf = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.disk_geometry = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.driver_client_cert = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.driver_data_namespace = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.driver_use_ssl = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.extra_capabilities = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.filter_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.goodness_function = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.iser_helper = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.iser_ip_address = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.iser_port = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.iser_target_prefix = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_host = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_login = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_mount_options = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_password = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_private_key = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_share_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_ssh_port = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.num_shell_tries = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.nvmet_port_id = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.replication_device = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.report_discard_supported = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.reserved_percentage = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.scst_target_driver = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.storage_protocol = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.target_helper = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.target_ip_address = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.target_port = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.target_prefix = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.target_protocol = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.trace_flags = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.use_chap_auth = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_clear = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_clear_size = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] QuobyteHD.volumes_dir = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.ssl = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_notifications.driver = [] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_notifications.retry = -1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] key_manager.fixed_key = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.barbican_api_version = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.barbican_endpoint = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.barbican_endpoint_type = public {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.barbican_region_name = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.cafile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.collect_timing = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.number_of_retries = 60 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.retry_delay = 1 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.send_service_user_token = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.split_loggers = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.verify_ssl = True {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican.verify_ssl_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.auth_section = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.auth_type = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.cafile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.certfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.collect_timing = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.insecure = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.keyfile = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.split_loggers = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] barbican_service_user.timeout = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.approle_role_id = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.approle_secret_id = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.kv_mountpoint = secret {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.kv_path = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.kv_version = 2 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.namespace = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.root_token_id = **** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.ssl_ca_crt_file = None {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.timeout = 60.0 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.use_ssl = False {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 05:08:21 devstack cinder-volume[86325]: DEBUG oslo_service.backend._eventlet.service [None req-2deaf0a8-9b70-46d3-86d0-08661b09cc43 None None] ******************************************************************************** {{(pid=86325) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 05:08:21 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.821s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:21 devstack cinder-volume[86688]: INFO cinder.volume.driver [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Driver hasn't implemented _init_vendor_properties() Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.volume.driver [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548027038574, 'free_capacity_gb': 1775.7548027038574, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86688) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_db.sqlalchemy.engines [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86688) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writer thread running {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.db.api [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Building query based on filter {{(pid=86688) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86688) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:08:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:21 devstack cinder-volume[86688]: INFO cinder.keymgr.migration [None req-0e7399e5-5a37-46ac-902b-3f626017a94f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 05:08:21 devstack sudo[86695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:08:21 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:22 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.646s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:08:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Driver initialization completed successfully. Jul 05 05:08:22 devstack cinder-volume[86688]: INFO cinder.manager [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Initiating service 3 cleanup Jul 05 05:08:22 devstack cinder-volume[86688]: INFO cinder.manager [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Service 3 cleanup completed. Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG cinder.service [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Creating RPC server for service cinder-volume {{(pid=86688) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG cinder.service [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86688) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 05:08:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:08:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:08:22 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:08:22 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:08:23 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Jul 05 05:08:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:08:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5c95a695-5864-480e-8b04-8626ba5cc11c None None] Driver post RPC initialization completed successfully. Jul 05 05:08:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:08:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 6 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:08:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:08:30 devstack cinder-volume[86325]: DEBUG dbcounter [-] [86325] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:08:32 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:08:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=2 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:09:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:09:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:09:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:09:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:09:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:09:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:09:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:09:30 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:09:30 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:09:32 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Jul 05 05:09:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.499s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:09:32 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:09:32 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:09:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 6 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:09:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:09:44 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Flow 'volume_create_manager' (2f8041fe-0883-4922-9e05-c48a6000b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4dd109-120a-4412-a2a5-df3bb8c12c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4dd109-120a-4412-a2a5-df3bb8c12c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-588049705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da912ea-cf76-4c79-9e2d-933cd9ab1f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aea17856e72486ba57873a408596b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:09:45Z,use_quota=True,user_id='3bfd61ea130349e6910ffb3f1e6f085f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9997163f-1835-4f2f-908c-376e065afacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9997163f-1835-4f2f-908c-376e065afacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f920398f-927a-446e-a6aa-3802c17e8d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f920398f-927a-446e-a6aa-3802c17e8d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da912ea-cf76-4c79-9e2d-933cd9ab1f75', 'volume_name': 'volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e99aa9-c2f6-409c-8bc9-5d631338cae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e99aa9-c2f6-409c-8bc9-5d631338cae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f77806-516f-424c-a109-03bb5dc99233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:45 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Volume 4da912ea-cf76-4c79-9e2d-933cd9ab1f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75', 'volume_size': 1} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-588049705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da912ea-cf76-4c79-9e2d-933cd9ab1f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aea17856e72486ba57873a408596b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:09:45Z,use_quota=True,user_id='3bfd61ea130349e6910ffb3f1e6f085f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Creating volume 4da912ea-cf76-4c79-9e2d-933cd9ab1f75 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:09:45 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:09:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:09:45 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 1073741824 Jul 05 05:09:45 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:09:47 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Jul 05 05:09:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 1073741824" returned: 0 in 2.508s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:09:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:09:48 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 Jul 05 05:09:48 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:09:49 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Jul 05 05:09:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75" returned: 0 in 1.563s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:09:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] <== create_volume: return (4233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:09:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.249s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:09:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f77806-516f-424c-a109-03bb5dc99233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11785e3e-a1cf-4636-ba88-61df65e9cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:49 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Volume volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 (4da912ea-cf76-4c79-9e2d-933cd9ab1f75): created successfully Jul 05 05:09:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11785e3e-a1cf-4636-ba88-61df65e9cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Flow 'volume_create_manager' (2f8041fe-0883-4922-9e05-c48a6000b603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:09:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-2e38cbc2-fdc5-41aa-b079-0b880af371e8 tempest-DeleteServersTestJSON-367698587 None] Created volume successfully. Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Flow 'volume_create_manager' (fa755988-0501-45c1-85ea-645ed03499a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b1f2c4-842d-4233-bd61-4708f03fe5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b1f2c4-842d-4233-bd61-4708f03fe5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-478445837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba0c995-044b-4894-857a-d1cb7c5bd027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1ff5dede73481f805ad979726959df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:09:50Z,use_quota=True,user_id='9d9607cc37934793893548d9c6677b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ba4729-8e7d-44d3-bb0e-631c204fa997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ba4729-8e7d-44d3-bb0e-631c204fa997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5c8dd6-9b89-4921-84f1-5c99cc2afdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5c8dd6-9b89-4921-84f1-5c99cc2afdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba0c995-044b-4894-857a-d1cb7c5bd027', 'volume_name': 'volume-9ba0c995-044b-4894-857a-d1cb7c5bd027', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12594207-b213-4e12-b7f9-bfdf4588054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12594207-b213-4e12-b7f9-bfdf4588054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7651ba23-2f9f-42fc-8cd9-833c5170f7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Volume 9ba0c995-044b-4894-857a-d1cb7c5bd027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba0c995-044b-4894-857a-d1cb7c5bd027', 'volume_size': 1} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-478445837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba0c995-044b-4894-857a-d1cb7c5bd027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1ff5dede73481f805ad979726959df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:09:50Z,use_quota=True,user_id='9d9607cc37934793893548d9c6677b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Creating volume 9ba0c995-044b-4894-857a-d1cb7c5bd027 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:09:50 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:09:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:09:50 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 1073741824 Jul 05 05:09:50 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:09:52 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Jul 05 05:09:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 1073741824" returned: 0 in 1.921s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:09:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:09:52 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 Jul 05 05:09:52 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:09:53 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Jul 05 05:09:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027" returned: 0 in 1.271s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:09:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] <== create_volume: return (3304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:09:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.306s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:09:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7651ba23-2f9f-42fc-8cd9-833c5170f7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba0c995-044b-4894-857a-d1cb7c5bd027', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e586e748-c2d8-4000-b780-50eead62b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:09:54 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Volume volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 (9ba0c995-044b-4894-857a-d1cb7c5bd027): created successfully Jul 05 05:09:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e586e748-c2d8-4000-b780-50eead62b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:09:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Flow 'volume_create_manager' (fa755988-0501-45c1-85ea-645ed03499a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:09:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ef3f2edd-6cd7-484b-9606-5ca45fecdb44 tempest-VolumesAdminNegativeTest-1289430427 None] Created volume successfully. Jul 05 05:09:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Acquiring lock "cinder-9ba0c995-044b-4894-857a-d1cb7c5bd027-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:09:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "cinder-9ba0c995-044b-4894-857a-d1cb7c5bd027-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:09:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Acquiring lock "cinder-quobyte-9ba0c995-044b-4894-857a-d1cb7c5bd027" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:09:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "cinder-quobyte-9ba0c995-044b-4894-857a-d1cb7c5bd027" acquired by "delete_volume" :: waited 0.047s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:09:56 devstack cinder-volume[86688]: INFO oslo.privsep.daemon [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpakrg7d7s/privsep.sock'] Jul 05 05:09:56 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpakrg7d7s/privsep.sock Jul 05 05:09:56 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 05:09:57 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 05:09:58 devstack cinder-volume[86688]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 05:09:59 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Jul 05 05:09:59 devstack cinder-volume[86688]: INFO oslo.privsep.daemon [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Spawned new privsep daemon via rootwrap Jul 05 05:09:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Accepted privsep connection to /tmp/tmpakrg7d7s/privsep.sock {{(pid=86688) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 05 05:09:59 devstack cinder-volume[86688]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 05 05:09:59 devstack cinder-volume[86688]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 05 05:09:59 devstack cinder-volume[86688]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 05 05:09:59 devstack cinder-volume[86688]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87812 Jul 05 05:09:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0397953a-69cb-4002-9ccc-84b96ca68520]: (2,) {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:09:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5ad85c-28f7-4a4f-86b7-70d48da8a534]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:09:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:09:59 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 Jul 05 05:09:59 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:00 devstack cinder-volume[86688]: WARNING py.warnings [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 05 05:10:00 devstack cinder-volume[86688]: .first() Jul 05 05:10:00 devstack cinder-volume[86688]: Jul 05 05:10:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce4e0ec-201d-478d-b709-7638eb6a7a87]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:10:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:00 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 Jul 05 05:10:00 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:01 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027" returned: 0 in 2.294s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:01 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027 Jul 05 05:10:01 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:01 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Flow 'volume_create_manager' (cb5d5775-4f9b-43d7-a480-94906c990981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c714c4-01ff-46c1-9023-5bf13b0e64ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c714c4-01ff-46c1-9023-5bf13b0e64ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1091331093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c980d84-1c49-4ae8-9536-165099b940d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac5bd360428474fb9d3e2831a4b89a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:10:02Z,use_quota=True,user_id='1678b17e45314e4eb81535bdd6b71a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b89f87-cb21-4680-a06d-2b62f1d999de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b89f87-cb21-4680-a06d-2b62f1d999de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2e9350-4a5c-499d-92a4-e43563ccbe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2e9350-4a5c-499d-92a4-e43563ccbe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c980d84-1c49-4ae8-9536-165099b940d0', 'volume_name': 'volume-1c980d84-1c49-4ae8-9536-165099b940d0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d44c9b-001d-42a6-9269-1b1c1854495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d44c9b-001d-42a6-9269-1b1c1854495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9217a1-9c73-4f7b-8591-0ccce8f016f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:02 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Volume 1c980d84-1c49-4ae8-9536-165099b940d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c980d84-1c49-4ae8-9536-165099b940d0', 'volume_size': 1} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:02 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75" returned: 0 in 1.594s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.646s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1091331093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c980d84-1c49-4ae8-9536-165099b940d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac5bd360428474fb9d3e2831a4b89a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:10:02Z,use_quota=True,user_id='1678b17e45314e4eb81535bdd6b71a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Creating volume 1c980d84-1c49-4ae8-9536-165099b940d0 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:10:02 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:02 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 1073741824 Jul 05 05:10:02 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b5fedc4-9d7b-4243-9ddf-975db9185990', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:10:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-83face52-6f37-4944-91c1-707694d03444 req-01aeba5a-a654-4097-a297-cd07d6e15586 tempest-DeleteServersTestJSON-367698587 None] attachment_update completed successfully. Jul 05 05:10:03 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9ba0c995-044b-4894-857a-d1cb7c5bd027" returned: 0 in 1.680s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "cinder-quobyte-9ba0c995-044b-4894-857a-d1cb7c5bd027" released by "delete_volume" :: held 7.474s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:10:03 devstack cinder-volume[86688]: WARNING cinder.quota [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:10:03 devstack cinder-volume[86688]: WARNING cinder.quota [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Created reservations ['6074306e-9759-45ce-904c-30e10c82c207', 'ba482eb8-90d2-401f-803a-b0f3bad9861f', '186f20ac-e59c-4594-b742-893c80d4444d', '9182b30c-0e65-4857-8e2b-24eea1ce6a82'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:10:04 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 1073741824" returned: 0 in 2.114s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:04 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:10:04 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:04 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 Jul 05 05:10:04 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:06 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.919s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:10:06 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Deleted volume successfully. Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ea377410-d5c2-437c-8bdb-f20e7a513531 tempest-VolumesAdminNegativeTest-1289430427 None] Lock "cinder-9ba0c995-044b-4894-857a-d1cb7c5bd027-delete_volume" released by "delete_volume" :: held 10.624s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:10:06 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0" returned: 0 in 2.047s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] <== create_volume: return (4385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.399s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9217a1-9c73-4f7b-8591-0ccce8f016f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c980d84-1c49-4ae8-9536-165099b940d0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4cb62e-8176-4cb5-ba84-7dbed8a6d421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Volume volume-1c980d84-1c49-4ae8-9536-165099b940d0 (1c980d84-1c49-4ae8-9536-165099b940d0): created successfully Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4cb62e-8176-4cb5-ba84-7dbed8a6d421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Flow 'volume_create_manager' (cb5d5775-4f9b-43d7-a480-94906c990981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:10:06 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-51f4bcfd-cbc4-4a2c-a96a-e1e44d2e2a18 tempest-ServerRescueNegativeTestJSON-654222723 None] Created volume successfully. Jul 05 05:10:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-180b956c-2912-4ada-9ade-42e9e3593dce req-88497b73-0c37-4882-8cf2-b03c065dbdfe tempest-DeleteServersTestJSON-367698587 None] Terminate volume connection completed successfully. Jul 05 05:10:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-180b956c-2912-4ada-9ade-42e9e3593dce req-88497b73-0c37-4882-8cf2-b03c065dbdfe tempest-DeleteServersTestJSON-367698587 None] Deleting attachment 0b5fedc4-9d7b-4243-9ddf-975db9185990. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:10:16 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=20,cinder:SELECT=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:10:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Acquiring lock "cinder-4da912ea-cf76-4c79-9e2d-933cd9ab1f75-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:10:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Lock "cinder-4da912ea-cf76-4c79-9e2d-933cd9ab1f75-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:10:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Acquiring lock "cinder-quobyte-4da912ea-cf76-4c79-9e2d-933cd9ab1f75" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:10:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Lock "cinder-quobyte-4da912ea-cf76-4c79-9e2d-933cd9ab1f75" acquired by "delete_volume" :: waited 0.042s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:10:20 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1685f0f-f79a-4846-b849-52ee563714e8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:10:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:20 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 Jul 05 05:10:20 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:21 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75" returned: 0 in 1.525s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:22 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75 Jul 05 05:10:22 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:23 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4da912ea-cf76-4c79-9e2d-933cd9ab1f75" returned: 0 in 1.220s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Lock "cinder-quobyte-4da912ea-cf76-4c79-9e2d-933cd9ab1f75" released by "delete_volume" :: held 2.860s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Created reservations ['dae2315c-a597-4a9f-bf37-62fc0bb90e57', 'a6491567-f4ba-420e-a854-7549a7e9421a', '865517c3-d435-4f50-bdde-1647a1b4bf5e', '767b2208-c4b1-448b-91c6-c32315c9b213'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:23 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:10:23 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:24 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:24 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:10:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Deleted volume successfully. Jul 05 05:10:24 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45cd4752-3aba-4566-a4c2-b729833db971 tempest-DeleteServersTestJSON-367698587 None] Lock "cinder-4da912ea-cf76-4c79-9e2d-933cd9ab1f75-delete_volume" released by "delete_volume" :: held 4.092s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:10:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:10:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:10:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:10:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:30 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:10:30 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:31 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.911s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:10:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:10:34 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=4 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Flow 'volume_create_manager' (31b3f221-a240-4c85-b682-26cd50010e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b1d068-f283-4793-bcaa-6f67709f3062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b1d068-f283-4793-bcaa-6f67709f3062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-8822327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccf15cf-3238-4b10-8005-4c64f6e3b5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11c62d0ded84a6c97c19c10083567c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:10:37Z,use_quota=True,user_id='3e362a07f9c3434590e4d766c533cae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359325fd-8d6b-448b-9e97-56ea890e4b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (359325fd-8d6b-448b-9e97-56ea890e4b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ebc28f-aaf0-4151-b3b8-3d2fd78ba1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ebc28f-aaf0-4151-b3b8-3d2fd78ba1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccf15cf-3238-4b10-8005-4c64f6e3b5b7', 'volume_name': 'volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344ebd06-cce8-4186-9243-6b58497745e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344ebd06-cce8-4186-9243-6b58497745e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3acdae4-b234-4b69-b4c2-a5780fd4fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Volume 3ccf15cf-3238-4b10-8005-4c64f6e3b5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7', 'volume_size': 1} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-8822327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccf15cf-3238-4b10-8005-4c64f6e3b5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11c62d0ded84a6c97c19c10083567c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:10:37Z,use_quota=True,user_id='3e362a07f9c3434590e4d766c533cae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Creating volume 3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:10:37 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:10:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:37 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 1073741824 Jul 05 05:10:37 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:38 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 1073741824" returned: 0 in 1.259s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:39 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 Jul 05 05:10:39 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Acquiring lock "cinder-1c980d84-1c49-4ae8-9536-165099b940d0-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "cinder-1c980d84-1c49-4ae8-9536-165099b940d0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Acquiring lock "cinder-quobyte-1c980d84-1c49-4ae8-9536-165099b940d0" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "cinder-quobyte-1c980d84-1c49-4ae8-9536-165099b940d0" acquired by "delete_volume" :: waited 0.046s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0ebd58-207c-4d77-a3f0-cff9c6193ea0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:10:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:39 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 Jul 05 05:10:39 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:40 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7" returned: 0 in 1.181s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:10:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.552s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3acdae4-b234-4b69-b4c2-a5780fd4fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901e31c4-ee8f-47b2-bd0b-0534b30fb77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:10:40 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Volume volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 (3ccf15cf-3238-4b10-8005-4c64f6e3b5b7): created successfully Jul 05 05:10:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901e31c4-ee8f-47b2-bd0b-0534b30fb77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:10:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Flow 'volume_create_manager' (31b3f221-a240-4c85-b682-26cd50010e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:10:40 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1a597398-ce40-4d44-990d-b9a95010241f tempest-TaggedAttachmentsTest-1617583327 None] Created volume successfully. Jul 05 05:10:41 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0" returned: 0 in 1.359s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:41 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0 Jul 05 05:10:41 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:41 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c980d84-1c49-4ae8-9536-165099b940d0" returned: 0 in 0.881s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:41 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "cinder-quobyte-1c980d84-1c49-4ae8-9536-165099b940d0" released by "delete_volume" :: held 2.366s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:10:42 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Created reservations ['c3d2bef4-fb39-482d-80b9-1df67f95f913', 'cf89ef33-c60b-4f0d-a134-fe1196dc58ad', 'afe41280-d962-4eab-a1b7-819eaee398a1', '017ff450-2a39-4974-8cd1-f9d0e820fdee'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:10:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:10:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:10:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:10:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:10:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:10:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:10:42 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:10:42 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:10:43 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Jul 05 05:10:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.186s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:10:43 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:10:43 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Deleted volume successfully. Jul 05 05:10:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c626c2f4-e5bd-455e-9e5f-7e4e460c46df tempest-ServerRescueNegativeTestJSON-654222723 None] Lock "cinder-1c980d84-1c49-4ae8-9536-165099b940d0-delete_volume" released by "delete_volume" :: held 3.908s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:10:52 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:10:53 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=9,cinder:INSERT=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:11:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:11:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:11:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:11:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:11:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:11:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:11:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:11:30 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:11:30 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:11:32 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Jul 05 05:11:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.474s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:11:32 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:11:32 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:11:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 8 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:11:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Flow 'volume_create_manager' (e55e3968-e312-4852-8e20-c0383f40f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76eb741c-ce40-4c77-9a2f-c0e28ebba231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76eb741c-ce40-4c77-9a2f-c0e28ebba231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-280211743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895259a7-100e-4449-9347-b22a98b6eb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0515632ede64b31ba997f46e7e039de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:11:43Z,use_quota=True,user_id='342bad7bf6af40c285a1da1646c5fdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5b177c-07cd-4e5c-95de-04b7dace5092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da5b177c-07cd-4e5c-95de-04b7dace5092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4657df56-8030-48fd-be48-56c6fb1415d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4657df56-8030-48fd-be48-56c6fb1415d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '895259a7-100e-4449-9347-b22a98b6eb40', 'volume_name': 'volume-895259a7-100e-4449-9347-b22a98b6eb40', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d38e8-b2ab-4112-a08f-f327f238a571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d38e8-b2ab-4112-a08f-f327f238a571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9c6991-8acc-4d11-a9c6-b79d72d377bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:43 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Volume 895259a7-100e-4449-9347-b22a98b6eb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-895259a7-100e-4449-9347-b22a98b6eb40', 'volume_size': 1} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-280211743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895259a7-100e-4449-9347-b22a98b6eb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0515632ede64b31ba997f46e7e039de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:11:43Z,use_quota=True,user_id='342bad7bf6af40c285a1da1646c5fdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Creating volume 895259a7-100e-4449-9347-b22a98b6eb40 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:11:43 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:11:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:11:43 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 1073741824 Jul 05 05:11:43 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:11:45 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Jul 05 05:11:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 1073741824" returned: 0 in 1.940s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:11:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:11:45 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 Jul 05 05:11:45 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:11:46 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Jul 05 05:11:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40" returned: 0 in 1.192s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:11:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] <== create_volume: return (3264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:11:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.267s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:11:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9c6991-8acc-4d11-a9c6-b79d72d377bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895259a7-100e-4449-9347-b22a98b6eb40', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9be838-bd93-4446-acac-f0f454fe6fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:46 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Volume volume-895259a7-100e-4449-9347-b22a98b6eb40 (895259a7-100e-4449-9347-b22a98b6eb40): created successfully Jul 05 05:11:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9be838-bd93-4446-acac-f0f454fe6fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Flow 'volume_create_manager' (e55e3968-e312-4852-8e20-c0383f40f620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:11:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4132b93f-39b9-49d6-8c1e-ce744f8d8e0e tempest-ServerActionsTestOtherA-1380680844 None] Created volume successfully. Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Flow 'volume_create_manager' (ba9bfc2c-ea48-4e1f-93d5-3e71c950965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df4581c-7a80-4975-9cf6-307e6760e6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df4581c-7a80-4975-9cf6-307e6760e6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1516960619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846ca543-f8fa-4cdd-9137-5fb2fcd6acb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096348b763004403ae72dcfe4b94f7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:11:54Z,use_quota=True,user_id='3379a4a167f64dfeaa9c1964dcfb6db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3309d3-e15f-4ab9-bade-610ee5536b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3309d3-e15f-4ab9-bade-610ee5536b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5be98f-19dc-4f35-93eb-b141b7620ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5be98f-19dc-4f35-93eb-b141b7620ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846ca543-f8fa-4cdd-9137-5fb2fcd6acb3', 'volume_name': 'volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68df8c99-e04c-44ba-81df-33cfcec12a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68df8c99-e04c-44ba-81df-33cfcec12a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e2e825-eb4f-43dd-a181-5709961e7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:54 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Volume 846ca543-f8fa-4cdd-9137-5fb2fcd6acb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3', 'volume_size': 1} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1516960619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846ca543-f8fa-4cdd-9137-5fb2fcd6acb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096348b763004403ae72dcfe4b94f7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:11:54Z,use_quota=True,user_id='3379a4a167f64dfeaa9c1964dcfb6db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Creating volume 846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:11:54 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:11:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:11:54 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 1073741824 Jul 05 05:11:54 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:11:55 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Jul 05 05:11:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 1073741824" returned: 0 in 1.192s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:11:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:11:55 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 Jul 05 05:11:55 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:11:56 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Jul 05 05:11:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3" returned: 0 in 1.071s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:11:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:11:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:11:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e2e825-eb4f-43dd-a181-5709961e7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8659d69c-ed8f-4cec-a27b-5a521e3973c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:11:56 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Volume volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 (846ca543-f8fa-4cdd-9137-5fb2fcd6acb3): created successfully Jul 05 05:11:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8659d69c-ed8f-4cec-a27b-5a521e3973c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:11:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Flow 'volume_create_manager' (ba9bfc2c-ea48-4e1f-93d5-3e71c950965a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:11:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1a508a9e-c86f-4367-b615-daaf0897f516 tempest-ServersNegativeTestJSON-320662515 None] Created volume successfully. Jul 05 05:11:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-3ca77de8-5e07-4e24-a248-846fd46691de req-0476e0df-5110-4b2a-a934-a5d8170e5778 tempest-TaggedAttachmentsTest-1617583327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:11:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-3ca77de8-5e07-4e24-a248-846fd46691de req-0476e0df-5110-4b2a-a934-a5d8170e5778 tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:11:58 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe269ef-3f13-4456-8d03-fadbcffe595a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:11:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-3ca77de8-5e07-4e24-a248-846fd46691de req-0476e0df-5110-4b2a-a934-a5d8170e5778 tempest-TaggedAttachmentsTest-1617583327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:11:58 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 Jul 05 05:11:58 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:11:59 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Jul 05 05:11:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-3ca77de8-5e07-4e24-a248-846fd46691de req-0476e0df-5110-4b2a-a934-a5d8170e5778 tempest-TaggedAttachmentsTest-1617583327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7" returned: 0 in 1.170s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:11:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-3ca77de8-5e07-4e24-a248-846fd46691de req-0476e0df-5110-4b2a-a934-a5d8170e5778 tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.212s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:11:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-3ca77de8-5e07-4e24-a248-846fd46691de req-0476e0df-5110-4b2a-a934-a5d8170e5778 tempest-TaggedAttachmentsTest-1617583327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db39445e-6651-48a0-9861-8b1b368d9309', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:11:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-3ca77de8-5e07-4e24-a248-846fd46691de req-0476e0df-5110-4b2a-a934-a5d8170e5778 tempest-TaggedAttachmentsTest-1617583327 None] attachment_update completed successfully. Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Flow 'volume_create_manager' (7b6d0224-c6eb-46e5-b7a2-922e2da7a282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f7e6ae-23d8-4e9b-bfad-68be6265b471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f7e6ae-23d8-4e9b-bfad-68be6265b471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1847189017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2503722-522f-4bf5-aae3-093925571868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096348b763004403ae72dcfe4b94f7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:12:00Z,use_quota=True,user_id='3379a4a167f64dfeaa9c1964dcfb6db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ca4909-d048-427f-b34d-f7c2cab48482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44ca4909-d048-427f-b34d-f7c2cab48482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd296089-3f58-40ad-b84b-bfa91a365a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd296089-3f58-40ad-b84b-bfa91a365a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2503722-522f-4bf5-aae3-093925571868', 'volume_name': 'volume-f2503722-522f-4bf5-aae3-093925571868', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968758d8-a037-41ba-8cc3-b09b3f05fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968758d8-a037-41ba-8cc3-b09b3f05fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493c3e95-b334-4ed3-ac20-ba2d3c4b430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:00 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Volume f2503722-522f-4bf5-aae3-093925571868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2503722-522f-4bf5-aae3-093925571868', 'volume_size': 1} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1847189017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2503722-522f-4bf5-aae3-093925571868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='096348b763004403ae72dcfe4b94f7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:12:00Z,use_quota=True,user_id='3379a4a167f64dfeaa9c1964dcfb6db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Creating volume f2503722-522f-4bf5-aae3-093925571868 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:12:00 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:12:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:00 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 1073741824 Jul 05 05:12:00 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:01 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 1073741824" returned: 0 in 1.138s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:01 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 Jul 05 05:12:01 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:02 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868" returned: 0 in 0.872s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:12:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493c3e95-b334-4ed3-ac20-ba2d3c4b430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2503722-522f-4bf5-aae3-093925571868', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d37e90-8c82-4289-8e63-c6879157e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:02 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Volume volume-f2503722-522f-4bf5-aae3-093925571868 (f2503722-522f-4bf5-aae3-093925571868): created successfully Jul 05 05:12:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d37e90-8c82-4289-8e63-c6879157e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Flow 'volume_create_manager' (7b6d0224-c6eb-46e5-b7a2-922e2da7a282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:12:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bc4258c3-46aa-4ce1-a55e-d9cbcb833133 tempest-ServersNegativeTestJSON-320662515 None] Created volume successfully. Jul 05 05:12:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "cinder-f2503722-522f-4bf5-aae3-093925571868-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:12:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-f2503722-522f-4bf5-aae3-093925571868-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:12:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "cinder-quobyte-f2503722-522f-4bf5-aae3-093925571868" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:12:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-quobyte-f2503722-522f-4bf5-aae3-093925571868" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:12:04 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bc4609-bf3e-41bf-b10c-faa1481a7769]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:12:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:04 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 Jul 05 05:12:04 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:05 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868" returned: 0 in 1.263s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:05 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868 Jul 05 05:12:05 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:06 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f2503722-522f-4bf5-aae3-093925571868" returned: 0 in 0.989s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-quobyte-f2503722-522f-4bf5-aae3-093925571868" released by "delete_volume" :: held 2.308s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Created reservations ['5609b157-8485-4ee2-9618-be6ae96ab310', 'dcd917ce-ce37-43dc-8452-a54463760d96', 'ae8b0dd9-9170-451d-8d35-dc7ce072ff12', '299c6f74-f054-4393-b79f-2491bf49b9a8'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:06 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:12:06 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-7e4c9eeb-57a7-4d42-9853-562bc89e5b59 req-8dc01962-9bf1-4593-a5c3-5af49ec8c016 tempest-TaggedAttachmentsTest-1617583327 None] Terminate volume connection completed successfully. Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-7e4c9eeb-57a7-4d42-9853-562bc89e5b59 req-8dc01962-9bf1-4593-a5c3-5af49ec8c016 tempest-TaggedAttachmentsTest-1617583327 None] Deleting attachment db39445e-6651-48a0-9861-8b1b368d9309. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "cinder-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "cinder-quobyte-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-quobyte-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3" acquired by "delete_volume" :: waited 0.043s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[59625e08-6c2f-4fb1-8b7b-0a8a5ea75914]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:07 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 Jul 05 05:12:07 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:07 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.419s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:07 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:12:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Deleted volume successfully. Jul 05 05:12:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e28fa08-ec90-4fcd-b4be-07cdd67a04de tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-f2503722-522f-4bf5-aae3-093925571868-delete_volume" released by "delete_volume" :: held 4.069s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:12:08 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3" returned: 0 in 1.056s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:08 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3 Jul 05 05:12:08 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:09 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3" returned: 0 in 0.891s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-quobyte-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3" released by "delete_volume" :: held 2.022s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Created reservations ['b2da9612-7141-40c0-9d2c-a977664a4817', '954d1f98-c778-430c-b745-f96d9e3ad3a5', '4a0d434e-6498-493d-996b-ac5cdf135a76', '1f76973e-7b20-40c8-88b0-dc5cf0cc1cec'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:09 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:12:09 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:10 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.842s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:10 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:12:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Deleted volume successfully. Jul 05 05:12:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-17da330e-434f-49fc-9d51-43377549e3c2 tempest-ServersNegativeTestJSON-320662515 None] Lock "cinder-846ca543-f8fa-4cdd-9137-5fb2fcd6acb3-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Flow 'volume_create_manager' (647536da-040d-4669-a34d-cd6fbc8d428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85eaac5-ce00-4941-81d8-719ed6d01577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85eaac5-ce00-4941-81d8-719ed6d01577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1986489505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89487fa4-3b12-4573-9b40-4a11b0a74ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6016cc19a40c498a4c932dd170497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:12:20Z,use_quota=True,user_id='e90c56d4e1fb4f83a56696b244323d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9b5abd-0acc-4dc4-8f02-4d8d232f3d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a9b5abd-0acc-4dc4-8f02-4d8d232f3d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0a7413-bb56-4ed7-8c19-69f632f99f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0a7413-bb56-4ed7-8c19-69f632f99f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89487fa4-3b12-4573-9b40-4a11b0a74ed3', 'volume_name': 'volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae3ca6-1ea9-4d96-891c-a32ea02c42d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ae3ca6-1ea9-4d96-891c-a32ea02c42d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7383f3f-ee6a-4c02-93e0-1d11fddacc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Volume 89487fa4-3b12-4573-9b40-4a11b0a74ed3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3', 'volume_size': 1} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1986489505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89487fa4-3b12-4573-9b40-4a11b0a74ed3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6016cc19a40c498a4c932dd170497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:12:20Z,use_quota=True,user_id='e90c56d4e1fb4f83a56696b244323d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Creating volume 89487fa4-3b12-4573-9b40-4a11b0a74ed3 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:12:19 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:12:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:19 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 1073741824 Jul 05 05:12:19 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:21 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 1073741824" returned: 0 in 1.187s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:21 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 Jul 05 05:12:21 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:21 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3" returned: 0 in 0.817s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:12:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7383f3f-ee6a-4c02-93e0-1d11fddacc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b947a8-2579-4694-a526-21e83dfc1422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:22 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Volume volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 (89487fa4-3b12-4573-9b40-4a11b0a74ed3): created successfully Jul 05 05:12:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b947a8-2579-4694-a526-21e83dfc1422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Flow 'volume_create_manager' (647536da-040d-4669-a34d-cd6fbc8d428f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:12:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3d01d4e2-3153-49ff-865c-d9806e079370 tempest-AttachVolumeTestJSON-2104421629 None] Created volume successfully. Jul 05 05:12:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-e30891c9-5141-4d3c-aad1-2aa6c8cc1c00 req-2e9716bb-a9ff-4808-96fb-6b68987bf77f tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-e30891c9-5141-4d3c-aad1-2aa6c8cc1c00 req-2e9716bb-a9ff-4808-96fb-6b68987bf77f tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bb2a80-ef00-4886-b0eb-cc89c20eb835]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:12:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-e30891c9-5141-4d3c-aad1-2aa6c8cc1c00 req-2e9716bb-a9ff-4808-96fb-6b68987bf77f tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:26 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 Jul 05 05:12:26 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Acquiring lock "cinder-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Lock "cinder-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Acquiring lock "cinder-quobyte-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Lock "cinder-quobyte-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7" acquired by "delete_volume" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:12:27 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-e30891c9-5141-4d3c-aad1-2aa6c8cc1c00 req-2e9716bb-a9ff-4808-96fb-6b68987bf77f tempest-AttachVolumeTestJSON-2104421629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3" returned: 0 in 1.014s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-e30891c9-5141-4d3c-aad1-2aa6c8cc1c00 req-2e9716bb-a9ff-4808-96fb-6b68987bf77f tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.039s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[041c6efc-560a-4718-b576-02d040bd23de]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-e30891c9-5141-4d3c-aad1-2aa6c8cc1c00 req-2e9716bb-a9ff-4808-96fb-6b68987bf77f tempest-AttachVolumeTestJSON-2104421629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0251025c-034d-465f-8d83-a5eaf7e5b029', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:12:27 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-e30891c9-5141-4d3c-aad1-2aa6c8cc1c00 req-2e9716bb-a9ff-4808-96fb-6b68987bf77f tempest-AttachVolumeTestJSON-2104421629 None] attachment_update completed successfully. Jul 05 05:12:27 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 Jul 05 05:12:27 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:28 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7" returned: 0 in 0.944s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:28 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7 Jul 05 05:12:28 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:28 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7" returned: 0 in 0.742s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Lock "cinder-quobyte-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7" released by "delete_volume" :: held 1.733s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Created reservations ['4058138c-bc30-431c-b23f-913a84f6df52', 'e207780f-a4a1-4755-b3f8-ebd39003f094', '1e090ed5-8982-4fc4-8eb6-f3838219f844', 'dcf9f430-a8cc-47b8-ba80-4d1b012e70bd'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:29 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:12:29 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:29 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:12:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Deleted volume successfully. Jul 05 05:12:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b5f25b25-0ae6-465d-953a-6aa1b9bb6f89 tempest-TaggedAttachmentsTest-1617583327 None] Lock "cinder-3ccf15cf-3238-4b10-8005-4c64f6e3b5b7-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:12:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:12:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:30 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:12:30 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:31 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.986s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:12:34 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=35,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:12:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-b3b717bd-5b3a-4e9a-ad73-18492638da88 req-226846f2-beb0-493b-9c0b-6aedfce6279c tempest-ServerActionsTestOtherA-1380680844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-b3b717bd-5b3a-4e9a-ad73-18492638da88 req-226846f2-beb0-493b-9c0b-6aedfce6279c tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db5434-1d5c-4a3a-a963-2f43f4249faa]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:12:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-b3b717bd-5b3a-4e9a-ad73-18492638da88 req-226846f2-beb0-493b-9c0b-6aedfce6279c tempest-ServerActionsTestOtherA-1380680844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:35 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 Jul 05 05:12:35 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:36 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-b3b717bd-5b3a-4e9a-ad73-18492638da88 req-226846f2-beb0-493b-9c0b-6aedfce6279c tempest-ServerActionsTestOtherA-1380680844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40" returned: 0 in 1.121s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-b3b717bd-5b3a-4e9a-ad73-18492638da88 req-226846f2-beb0-493b-9c0b-6aedfce6279c tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.151s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-b3b717bd-5b3a-4e9a-ad73-18492638da88 req-226846f2-beb0-493b-9c0b-6aedfce6279c tempest-ServerActionsTestOtherA-1380680844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-895259a7-100e-4449-9347-b22a98b6eb40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aba2e8e4-b7dc-415e-b0cc-00881aba91d6', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:12:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-b3b717bd-5b3a-4e9a-ad73-18492638da88 req-226846f2-beb0-493b-9c0b-6aedfce6279c tempest-ServerActionsTestOtherA-1380680844 None] attachment_update completed successfully. Jul 05 05:12:45 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-ad47e8b7-9c7f-4eb0-acfe-69c8c95d62d7 tempest-ServerActionsTestOtherA-1380680844 None] Terminate volume connection completed successfully. Jul 05 05:12:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-ad47e8b7-9c7f-4eb0-acfe-69c8c95d62d7 tempest-ServerActionsTestOtherA-1380680844 None] Deleting attachment aba2e8e4-b7dc-415e-b0cc-00881aba91d6. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:12:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-492add13-95cb-41e5-82f2-8b7ea7961c0e tempest-ServerActionsTestOtherA-1380680844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-492add13-95cb-41e5-82f2-8b7ea7961c0e tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:48 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c99e5f1-d32e-4613-b2d8-8a555045a816]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:12:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-492add13-95cb-41e5-82f2-8b7ea7961c0e tempest-ServerActionsTestOtherA-1380680844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:48 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 Jul 05 05:12:48 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bbd0e4a6-31c2-41d0-bb74-c8c64e379493 tempest-GroupsTest-1575733848 None] Group tempest-Group1-200884585: creating Jul 05 05:12:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bbd0e4a6-31c2-41d0-bb74-c8c64e379493 tempest-GroupsTest-1575733848 None] Group tempest-Group1-200884585: created successfully Jul 05 05:12:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bbd0e4a6-31c2-41d0-bb74-c8c64e379493 tempest-GroupsTest-1575733848 None] Create group completed successfully. Jul 05 05:12:49 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-492add13-95cb-41e5-82f2-8b7ea7961c0e tempest-ServerActionsTestOtherA-1380680844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40" returned: 0 in 0.929s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-492add13-95cb-41e5-82f2-8b7ea7961c0e tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.952s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-492add13-95cb-41e5-82f2-8b7ea7961c0e tempest-ServerActionsTestOtherA-1380680844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-895259a7-100e-4449-9347-b22a98b6eb40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28492d4b-6718-44ba-b752-1c140f751243', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:12:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-5fcbee91-90ad-4f4c-8561-96d98989eb4f req-492add13-95cb-41e5-82f2-8b7ea7961c0e tempest-ServerActionsTestOtherA-1380680844 None] attachment_update completed successfully. Jul 05 05:12:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7dc1c390-f3e4-47ad-8ec1-ee9d93e66fb0 tempest-GroupsTest-1575733848 None] Group tempest-Group2-728670327: creating Jul 05 05:12:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7dc1c390-f3e4-47ad-8ec1-ee9d93e66fb0 tempest-GroupsTest-1575733848 None] Group tempest-Group2-728670327: created successfully Jul 05 05:12:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7dc1c390-f3e4-47ad-8ec1-ee9d93e66fb0 tempest-GroupsTest-1575733848 None] Create group completed successfully. Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Flow 'volume_create_manager' (c8f92794-333e-4d10-bc07-ff40291974cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51597743-ffec-44c5-9831-1db7e070a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51597743-ffec-44c5-9831-1db7e070a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-790892512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52dad511-d4b0-4ea7-b51f-3724b263a605,host='devstack@QuobyteHD#QuobyteHD',id=0a352473-7b8b-43e1-9a92-2776b3a647af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a667f17b0a404d965652ec0c0c896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:12:51Z,use_quota=True,user_id='4438f322c35e46cfa2b0e0e7a9bd1699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c176e768-b1af-40dd-9d6a-65d5e0a07374),volume_type_id=c176e768-b1af-40dd-9d6a-65d5e0a07374)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9137fecc-1ede-4dae-99e0-d9e3897dab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9137fecc-1ede-4dae-99e0-d9e3897dab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b35b13d-8e73-49c5-ab85-1c5420a963a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b35b13d-8e73-49c5-ab85-1c5420a963a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a352473-7b8b-43e1-9a92-2776b3a647af', 'volume_name': 'volume-0a352473-7b8b-43e1-9a92-2776b3a647af', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766d3422-7d07-44cf-a73e-cc76e887d6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766d3422-7d07-44cf-a73e-cc76e887d6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100e5e34-33d3-43ee-9ee0-825c42e14611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:51 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Volume 0a352473-7b8b-43e1-9a92-2776b3a647af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a352473-7b8b-43e1-9a92-2776b3a647af', 'volume_size': 1} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52dad511-d4b0-4ea7-b51f-3724b263a605,created_at=2026-07-05T03:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-790892512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52dad511-d4b0-4ea7-b51f-3724b263a605,host='devstack@QuobyteHD#QuobyteHD',id=0a352473-7b8b-43e1-9a92-2776b3a647af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a667f17b0a404d965652ec0c0c896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:12:51Z,use_quota=True,user_id='4438f322c35e46cfa2b0e0e7a9bd1699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c176e768-b1af-40dd-9d6a-65d5e0a07374),volume_type_id=c176e768-b1af-40dd-9d6a-65d5e0a07374)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Creating volume 0a352473-7b8b-43e1-9a92-2776b3a647af {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:12:51 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:12:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:51 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af 1073741824 Jul 05 05:12:51 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:52 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af 1073741824" returned: 0 in 1.139s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:52 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af Jul 05 05:12:52 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:53 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af" returned: 0 in 0.829s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:12:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100e5e34-33d3-43ee-9ee0-825c42e14611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a352473-7b8b-43e1-9a92-2776b3a647af', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b5e937-da2d-451b-a5d8-65c693443206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:12:53 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Volume volume-0a352473-7b8b-43e1-9a92-2776b3a647af (0a352473-7b8b-43e1-9a92-2776b3a647af): created successfully Jul 05 05:12:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b5e937-da2d-451b-a5d8-65c693443206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:12:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Flow 'volume_create_manager' (c8f92794-333e-4d10-bc07-ff40291974cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:12:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4bba3640-b5fb-4f75-98b7-21f809df8727 tempest-GroupsTest-1575733848 None] Created volume successfully. Jul 05 05:12:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Acquiring lock "cinder-quobyte-0a352473-7b8b-43e1-9a92-2776b3a647af" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:12:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Lock "cinder-quobyte-0a352473-7b8b-43e1-9a92-2776b3a647af" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:12:55 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ce2c0-1ce0-49eb-b568-95cf4d2d2f3a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:12:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:55 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af Jul 05 05:12:55 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:56 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af" returned: 0 in 1.005s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:56 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af Jul 05 05:12:56 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:56 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0a352473-7b8b-43e1-9a92-2776b3a647af" returned: 0 in 0.892s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Lock "cinder-quobyte-0a352473-7b8b-43e1-9a92-2776b3a647af" released by "delete_volume" :: held 1.953s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Created reservations ['b90a7206-4abc-4f16-b6bd-666326076e29'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:12:57 devstack cinder-volume[86688]: WARNING cinder.quota [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1863876135 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1863876135, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:12:57 devstack cinder-volume[86688]: WARNING cinder.quota [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1863876135 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1863876135, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Created reservations ['c9e7cbd9-3080-47d9-b7e7-2d7e497d0ef9', '21bd630a-f7c1-4e85-8f26-1d6e0a9df9c1', 'bccff6d6-45d2-4de8-a5d8-6ea7ea07ba70', '6cb7d848-c168-46fa-ad8d-23354fbf01ca'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:57 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:12:57 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Created reservations ['9fb0fbaa-803a-438f-b8b3-1d588916bead'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:12:58 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:12:58 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:12:58 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.429s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:58 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:12:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-23ba719e-9bd3-4c2a-b9ed-e81e3c84ebb1 tempest-GroupsTest-1575733848 None] Delete group completed successfully. Jul 05 05:12:59 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jul 05 05:12:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.343s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:12:59 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:12:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b26f7c70-81bd-4ef9-a08a-0fdc15cc0e92 tempest-GroupsTest-1575733848 None] Delete group completed successfully. Jul 05 05:13:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1b6731e3-02cb-475d-86e1-2049d89d62a7 tempest-GroupsTest-1575733848 None] Group tempest-GroupsTest-Group-1155822395: creating Jul 05 05:13:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1b6731e3-02cb-475d-86e1-2049d89d62a7 tempest-GroupsTest-1575733848 None] Group tempest-GroupsTest-Group-1155822395: created successfully Jul 05 05:13:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1b6731e3-02cb-475d-86e1-2049d89d62a7 tempest-GroupsTest-1575733848 None] Create group completed successfully. Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Flow 'volume_create_manager' (e8f4d068-98c1-42de-a967-f3cadf61598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a96ae4-ebf8-4bdd-a41d-d3ad2abd617a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a96ae4-ebf8-4bdd-a41d-d3ad2abd617a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037172625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53afdc12-6225-4eb7-befe-8519d894d835,host='devstack@QuobyteHD#QuobyteHD',id=d66fe5d2-97a9-472d-b97f-0e4868271b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a667f17b0a404d965652ec0c0c896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:02Z,use_quota=True,user_id='4438f322c35e46cfa2b0e0e7a9bd1699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(110e62e8-7667-4a0f-a019-86fd4d17e368),volume_type_id=110e62e8-7667-4a0f-a019-86fd4d17e368)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bcfc49-3e38-4427-a65a-0f82f93e7926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bcfc49-3e38-4427-a65a-0f82f93e7926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56f779e-3563-4d78-898c-5a242c03fb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56f779e-3563-4d78-898c-5a242c03fb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66fe5d2-97a9-472d-b97f-0e4868271b35', 'volume_name': 'volume-d66fe5d2-97a9-472d-b97f-0e4868271b35', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11ecd0b-3bd6-425c-8191-36828f870333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11ecd0b-3bd6-425c-8191-36828f870333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1ccb5c-8b26-4ae5-886a-ac8ab45b30e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:01 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Volume d66fe5d2-97a9-472d-b97f-0e4868271b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66fe5d2-97a9-472d-b97f-0e4868271b35', 'volume_size': 1} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53afdc12-6225-4eb7-befe-8519d894d835,created_at=2026-07-05T03:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037172625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53afdc12-6225-4eb7-befe-8519d894d835,host='devstack@QuobyteHD#QuobyteHD',id=d66fe5d2-97a9-472d-b97f-0e4868271b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a667f17b0a404d965652ec0c0c896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:02Z,use_quota=True,user_id='4438f322c35e46cfa2b0e0e7a9bd1699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(110e62e8-7667-4a0f-a019-86fd4d17e368),volume_type_id=110e62e8-7667-4a0f-a019-86fd4d17e368)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Creating volume d66fe5d2-97a9-472d-b97f-0e4868271b35 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:13:01 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:13:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:02 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 1073741824 Jul 05 05:13:02 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:02 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 1073741824" returned: 0 in 0.913s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:02 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 Jul 05 05:13:02 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:03 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35" returned: 0 in 0.736s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:13:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1ccb5c-8b26-4ae5-886a-ac8ab45b30e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66fe5d2-97a9-472d-b97f-0e4868271b35', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871f3f42-f470-4542-b268-aa5962c3cca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:03 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Volume volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 (d66fe5d2-97a9-472d-b97f-0e4868271b35): created successfully Jul 05 05:13:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871f3f42-f470-4542-b268-aa5962c3cca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Flow 'volume_create_manager' (e8f4d068-98c1-42de-a967-f3cadf61598d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-547887f7-47fc-4fed-bf83-5adc6a089bb0 tempest-GroupsTest-1575733848 None] Created volume successfully. Jul 05 05:13:04 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:13:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Flow 'volume_create_manager' (44a3825c-7c6d-48e3-be65-299a55a8613e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ebb977-d172-4348-b310-fbccc9eca030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ebb977-d172-4348-b310-fbccc9eca030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55192927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53afdc12-6225-4eb7-befe-8519d894d835,host='devstack@QuobyteHD#QuobyteHD',id=13040a8b-152a-4513-ac33-3b7b974be721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a667f17b0a404d965652ec0c0c896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:05Z,use_quota=True,user_id='4438f322c35e46cfa2b0e0e7a9bd1699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(110e62e8-7667-4a0f-a019-86fd4d17e368),volume_type_id=110e62e8-7667-4a0f-a019-86fd4d17e368)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9df8b1-2ae2-4dd9-bc10-513fa17ef297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9df8b1-2ae2-4dd9-bc10-513fa17ef297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dea7a46-4009-41f1-b877-47b8aad3a5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dea7a46-4009-41f1-b877-47b8aad3a5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13040a8b-152a-4513-ac33-3b7b974be721', 'volume_name': 'volume-13040a8b-152a-4513-ac33-3b7b974be721', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409cefc5-9ed0-4ca5-a8e2-b9069b966258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409cefc5-9ed0-4ca5-a8e2-b9069b966258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97647ab-e4a4-47c5-b937-7effce183c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:05 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Volume 13040a8b-152a-4513-ac33-3b7b974be721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13040a8b-152a-4513-ac33-3b7b974be721', 'volume_size': 1} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53afdc12-6225-4eb7-befe-8519d894d835,created_at=2026-07-05T03:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55192927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53afdc12-6225-4eb7-befe-8519d894d835,host='devstack@QuobyteHD#QuobyteHD',id=13040a8b-152a-4513-ac33-3b7b974be721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a667f17b0a404d965652ec0c0c896e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:05Z,use_quota=True,user_id='4438f322c35e46cfa2b0e0e7a9bd1699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(110e62e8-7667-4a0f-a019-86fd4d17e368),volume_type_id=110e62e8-7667-4a0f-a019-86fd4d17e368)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Creating volume 13040a8b-152a-4513-ac33-3b7b974be721 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:13:05 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:05 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 1073741824 Jul 05 05:13:05 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:05 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 1073741824" returned: 0 in 0.780s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:05 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 Jul 05 05:13:05 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:06 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721" returned: 0 in 0.718s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:13:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97647ab-e4a4-47c5-b937-7effce183c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13040a8b-152a-4513-ac33-3b7b974be721', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede01834-c52a-432c-b2cf-8e4bb81b8250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Volume volume-13040a8b-152a-4513-ac33-3b7b974be721 (13040a8b-152a-4513-ac33-3b7b974be721): created successfully Jul 05 05:13:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ede01834-c52a-432c-b2cf-8e4bb81b8250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Flow 'volume_create_manager' (44a3825c-7c6d-48e3-be65-299a55a8613e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:06 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1f19825a-12e2-4e56-8ab7-097d601b9fb9 tempest-GroupsTest-1575733848 None] Created volume successfully. Jul 05 05:13:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e89e2dd6-c3ac-42eb-8fcb-4e72bf84225f tempest-GroupsTest-1575733848 None] Update group completed successfully. Jul 05 05:13:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ef410a73-cd86-4f62-a866-e6f748a13dd9 tempest-GroupsTest-1575733848 None] Update group completed successfully. Jul 05 05:13:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Acquiring lock "cinder-quobyte-13040a8b-152a-4513-ac33-3b7b974be721" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Lock "cinder-quobyte-13040a8b-152a-4513-ac33-3b7b974be721" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:10 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f373e9a-8afa-4f6a-83cb-4c60d6c4c2b7]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:10 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 Jul 05 05:13:10 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:11 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721" returned: 0 in 0.805s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:11 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721 Jul 05 05:13:11 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:12 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-13040a8b-152a-4513-ac33-3b7b974be721" returned: 0 in 0.647s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Lock "cinder-quobyte-13040a8b-152a-4513-ac33-3b7b974be721" released by "delete_volume" :: held 1.490s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Acquiring lock "cinder-quobyte-d66fe5d2-97a9-472d-b97f-0e4868271b35" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Lock "cinder-quobyte-d66fe5d2-97a9-472d-b97f-0e4868271b35" acquired by "delete_volume" :: waited 0.012s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cab719-433f-4823-8440-36ce89475c19]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:12 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 Jul 05 05:13:12 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:12 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35" returned: 0 in 0.755s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:12 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35 Jul 05 05:13:12 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:13 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d66fe5d2-97a9-472d-b97f-0e4868271b35" returned: 0 in 0.639s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Lock "cinder-quobyte-d66fe5d2-97a9-472d-b97f-0e4868271b35" released by "delete_volume" :: held 1.431s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Created reservations ['b91efd63-bfb9-4781-be6a-d0b83bc978eb'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:13 devstack cinder-volume[86688]: WARNING cinder.quota [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1628388674 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1628388674, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:13:13 devstack cinder-volume[86688]: WARNING cinder.quota [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1628388674 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1628388674, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Created reservations ['14a32319-16cb-4490-afa1-bd949e5502b5', '709d3ad5-df94-4bcf-b59c-9c776f0e8b29', '107febe9-779d-4dd2-96ad-ddcc91c3c7a7', 'b405f8ad-be51-40da-858a-2002f101ed50'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Created reservations ['798b6087-3eab-4a03-9fff-14de77a68951', 'cb140626-1264-42b4-b661-7a6034ea0a4a', '142de565-c2c1-4c2a-bc5a-cafac13ae990', '1352ce0c-8607-4066-a054-8801067fbe32'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:13 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:13:13 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:14 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.690s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:14 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:13:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-490700e1-a238-4574-bb79-9df7e6dc36ad tempest-GroupsTest-1575733848 None] Delete group completed successfully. Jul 05 05:13:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d019f378-dc63-43c7-94cd-b852700aebc2 tempest-GroupsV314Test-1186870175 None] Group tempest-GroupsV314Test-Group-1469099632: creating Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Flow 'volume_create_manager' (eeccfab5-1770-4aad-955b-17bb612ead19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6415dc26-055e-4215-9d60-edfe9f696de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6415dc26-055e-4215-9d60-edfe9f696de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-399984515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b2103f-01c7-4413-a6f8-d905d61c0380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9eaa9d72de248fab142f3502eb748a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:19Z,use_quota=True,user_id='08e02411f33840e6b399edaea94ff619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c240fc13-0e0a-4736-84fe-7ea8d6d9d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c240fc13-0e0a-4736-84fe-7ea8d6d9d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967deebe-8ac8-4928-85e3-eb8ba09d7a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967deebe-8ac8-4928-85e3-eb8ba09d7a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b2103f-01c7-4413-a6f8-d905d61c0380', 'volume_name': 'volume-01b2103f-01c7-4413-a6f8-d905d61c0380', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a6629b-afe9-41b4-97ea-5c53bf2b1ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a6629b-afe9-41b4-97ea-5c53bf2b1ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaa1bac-da71-46ca-a024-767dd2b7e6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Volume 01b2103f-01c7-4413-a6f8-d905d61c0380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b2103f-01c7-4413-a6f8-d905d61c0380', 'volume_size': 1} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-399984515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b2103f-01c7-4413-a6f8-d905d61c0380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9eaa9d72de248fab142f3502eb748a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:19Z,use_quota=True,user_id='08e02411f33840e6b399edaea94ff619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Creating volume 01b2103f-01c7-4413-a6f8-d905d61c0380 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:13:19 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:13:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d019f378-dc63-43c7-94cd-b852700aebc2 tempest-GroupsV314Test-1186870175 None] Group tempest-GroupsV314Test-Group-1469099632: created successfully Jul 05 05:13:19 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 1073741824 Jul 05 05:13:19 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d019f378-dc63-43c7-94cd-b852700aebc2 tempest-GroupsV314Test-1186870175 None] Create group completed successfully. Jul 05 05:13:20 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 1073741824" returned: 0 in 0.918s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:20 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=58,cinder:INSERT=11,cinder:UPDATE=65,cinder:DELETE=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:13:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:20 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 Jul 05 05:13:20 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Flow 'volume_create_manager' (af59507a-73fa-429d-b176-25fa04f1b0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8caa97db-63f5-4207-b9ca-fb3bbebd9bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8caa97db-63f5-4207-b9ca-fb3bbebd9bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718920013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bca63dd4-b1a9-4033-9d1d-d8932a92ec45,host='devstack@QuobyteHD#QuobyteHD',id=4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7fb83f380045c3bc5900c6770ef397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:21Z,use_quota=True,user_id='8ab166941c944fc0b22ec4b79910aafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7d43d38-840d-4fa0-b3c5-da25dae2601d),volume_type_id=b7d43d38-840d-4fa0-b3c5-da25dae2601d)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8403622-7e3d-4ed7-b6af-4eb9049fde0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8403622-7e3d-4ed7-b6af-4eb9049fde0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066db469-9b8a-4e0d-b71f-fbcd8607c906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066db469-9b8a-4e0d-b71f-fbcd8607c906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1', 'volume_name': 'volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10c163a-a8c9-42cf-8b39-bcf6211c2dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c10c163a-a8c9-42cf-8b39-bcf6211c2dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227552d5-eea3-4f2a-ab85-f82bb8991023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Volume 4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1', 'volume_size': 1} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:21 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380" returned: 0 in 0.734s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bca63dd4-b1a9-4033-9d1d-d8932a92ec45,created_at=2026-07-05T03:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1718920013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bca63dd4-b1a9-4033-9d1d-d8932a92ec45,host='devstack@QuobyteHD#QuobyteHD',id=4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c7fb83f380045c3bc5900c6770ef397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:13:21Z,use_quota=True,user_id='8ab166941c944fc0b22ec4b79910aafb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7d43d38-840d-4fa0-b3c5-da25dae2601d),volume_type_id=b7d43d38-840d-4fa0-b3c5-da25dae2601d)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Creating volume 4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:13:21 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daaa1bac-da71-46ca-a024-767dd2b7e6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b2103f-01c7-4413-a6f8-d905d61c0380', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931a26e8-cf46-4fd7-99d4-c595d8aa5e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:21 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 1073741824 Jul 05 05:13:21 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Volume volume-01b2103f-01c7-4413-a6f8-d905d61c0380 (01b2103f-01c7-4413-a6f8-d905d61c0380): created successfully Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931a26e8-cf46-4fd7-99d4-c595d8aa5e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Flow 'volume_create_manager' (eeccfab5-1770-4aad-955b-17bb612ead19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-2343e28c-e5a0-4e78-af86-09d9e9a1a914 tempest-AttachVolumeNegativeTest-1383062054 None] Created volume successfully. Jul 05 05:13:22 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 1073741824" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:22 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 Jul 05 05:13:22 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-70d9027c-aea8-4743-92e7-7edfb820ab0e req-b2c673cf-f21d-458d-8e3d-f8afc6249886 tempest-ServerActionsTestOtherA-1380680844 None] Terminate volume connection completed successfully. Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-70d9027c-aea8-4743-92e7-7edfb820ab0e req-b2c673cf-f21d-458d-8e3d-f8afc6249886 tempest-ServerActionsTestOtherA-1380680844 None] Deleting attachment 28492d4b-6718-44ba-b752-1c140f751243. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:13:22 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" returned: 0 in 0.714s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227552d5-eea3-4f2a-ab85-f82bb8991023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1905810d-5711-42b0-b81d-223eb9672b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:13:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Volume volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 (4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1): created successfully Jul 05 05:13:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1905810d-5711-42b0-b81d-223eb9672b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:13:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Flow 'volume_create_manager' (af59507a-73fa-429d-b176-25fa04f1b0bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:13:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ccd0e761-b28a-43c3-9097-7a6dd0edb4c4 tempest-GroupsV314Test-1186870175 None] Created volume successfully. Jul 05 05:13:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-0f51ff07-8de6-4d4c-b94c-ae8b69dd628e req-1485b597-e41a-414d-bcbc-dd5ebd19a5f4 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-0f51ff07-8de6-4d4c-b94c-ae8b69dd628e req-1485b597-e41a-414d-bcbc-dd5ebd19a5f4 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:24 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3764592-1f18-40b4-a403-63d821e9f708]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-0f51ff07-8de6-4d4c-b94c-ae8b69dd628e req-1485b597-e41a-414d-bcbc-dd5ebd19a5f4 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:25 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 Jul 05 05:13:25 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:25 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-0f51ff07-8de6-4d4c-b94c-ae8b69dd628e req-1485b597-e41a-414d-bcbc-dd5ebd19a5f4 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380" returned: 0 in 0.838s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-0f51ff07-8de6-4d4c-b94c-ae8b69dd628e req-1485b597-e41a-414d-bcbc-dd5ebd19a5f4 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.875s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.744s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:25 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Cloning volume 4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 to volume ec999998-3b72-4f55-85c6-1c3b677ad0da Jul 05 05:13:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Creating offline snapshot b6de56dc-9af8-4cee-b537-171d31d22dc3 of volume 4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:13:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-0f51ff07-8de6-4d4c-b94c-ae8b69dd628e req-1485b597-e41a-414d-bcbc-dd5ebd19a5f4 tempest-AttachVolumeNegativeTest-1383062054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-01b2103f-01c7-4413-a6f8-d905d61c0380', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f96f1bfc-a0a4-4f02-badf-73fa46a0b644', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:13:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d174ce-9e88-4fca-9d3c-53d64d3b94a0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:25 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-0f51ff07-8de6-4d4c-b94c-ae8b69dd628e req-1485b597-e41a-414d-bcbc-dd5ebd19a5f4 tempest-AttachVolumeNegativeTest-1383062054 None] attachment_update completed successfully. Jul 05 05:13:25 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 Jul 05 05:13:25 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:26 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" returned: 0 in 0.996s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:26 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 1G Jul 05 05:13:26 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:27 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 1G" returned: 0 in 0.950s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:27 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 Jul 05 05:13:27 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:28 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3" returned: 0 in 0.775s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:28 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:13:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:28 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 Jul 05 05:13:28 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:29 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3" returned: 0 in 0.681s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:29 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.info Jul 05 05:13:29 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:29 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.info" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:29 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:13:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:29 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.info Jul 05 05:13:29 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:30 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.info" returned: 0 in 0.660s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:30 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:13:30 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Acquiring lock "cinder-quobyte-ec999998-3b72-4f55-85c6-1c3b677ad0da" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-ec999998-3b72-4f55-85c6-1c3b677ad0da" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] snapshot: b6de56dc-9af8-4cee-b537-171d31d22dc3, volume: ec999998-3b72-4f55-85c6-1c3b677ad0da, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e97ba53-8b1e-4ea5-9a73-ee3aae8164d5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:30 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 Jul 05 05:13:30 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:31 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.856s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 8 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:13:31 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3" returned: 0 in 0.962s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0fca7f-3158-4439-8be4-df94ce1ddfc6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:31 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 Jul 05 05:13:31 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:32 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" returned: 0 in 0.949s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:32 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:13:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:32 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da Jul 05 05:13:32 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Acquiring lock "cinder-895259a7-100e-4449-9347-b22a98b6eb40-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Lock "cinder-895259a7-100e-4449-9347-b22a98b6eb40-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Acquiring lock "cinder-quobyte-895259a7-100e-4449-9347-b22a98b6eb40" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Lock "cinder-quobyte-895259a7-100e-4449-9347-b22a98b6eb40" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7838cd4-c3db-4f6b-b278-7637bfb60b89]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:33 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 Jul 05 05:13:33 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:35 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40" returned: 0 in 2.117s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:35 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40 Jul 05 05:13:35 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:37 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-895259a7-100e-4449-9347-b22a98b6eb40" returned: 0 in 2.048s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Lock "cinder-quobyte-895259a7-100e-4449-9347-b22a98b6eb40" released by "delete_volume" :: held 4.218s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=75,cinder:UPDATE=62,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Created reservations ['1756a761-acdc-4c82-a22a-a18c17c8600b', '33f664b9-08d8-42e0-951d-e5b4e5251b57', '60a40dbd-d886-4742-a5e3-1bac9694879b', '147971be-1406-4d8c-a433-aa97b5305cd3'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:37 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:13:37 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:38 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da" returned: 0 in 6.064s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:38 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c921697a-f689-45d5-a0c9-8d84fdc25719]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:38 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.009s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:38 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:13:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Deleted volume successfully. Jul 05 05:13:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb4846bb-4436-4ba7-9123-1e3da4d678bd tempest-ServerActionsTestOtherA-1380680844 None] Lock "cinder-895259a7-100e-4449-9347-b22a98b6eb40-delete_volume" released by "delete_volume" :: held 5.598s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:38 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 Jul 05 05:13:38 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:39 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" returned: 0 in 0.994s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:39 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:13:39 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Converted 1024.00 MB image at 168.81 MB/s Jul 05 05:13:39 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:13:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:39 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da Jul 05 05:13:39 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:40 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da" returned: 0 in 0.740s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-ec999998-3b72-4f55-85c6-1c3b677ad0da" released by "_copy_volume_from_snapshot" :: held 9.840s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Acquiring lock "cinder-quobyte-b6de56dc-9af8-4cee-b537-171d31d22dc3" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-b6de56dc-9af8-4cee-b537-171d31d22dc3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Deleting offline snapshot b6de56dc-9af8-4cee-b537-171d31d22dc3 of volume 4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] snapshot_file for this snap is: volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b076e7e6-64fe-44b8-a9c9-1364f1f88713]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:40 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 Jul 05 05:13:40 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:41 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3" returned: 0 in 0.884s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:13:41 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[092bfa1d-dab6-4164-a664-9c8c96396392]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:41 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 Jul 05 05:13:41 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:42 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" returned: 0 in 0.939s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:42 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 Jul 05 05:13:42 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:43 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3" returned: 0 in 0.945s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:43 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3 Jul 05 05:13:43 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:44 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1.b6de56dc-9af8-4cee-b537-171d31d22dc3" returned: 0 in 0.761s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-b6de56dc-9af8-4cee-b537-171d31d22dc3" released by "_delete_snapshot" :: held 3.623s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.395s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4d375789-ef00-4320-93fd-4828b2bf08c5 tempest-GroupsV314Test-1186870175 None] Create group from source-group-bca63dd4-b1a9-4033-9d1d-d8932a92ec45 completed successfully. Jul 05 05:13:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Acquiring lock "cinder-quobyte-ec999998-3b72-4f55-85c6-1c3b677ad0da" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-ec999998-3b72-4f55-85c6-1c3b677ad0da" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d9b64-1243-41d6-acef-bd2edc9abc52]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:45 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da Jul 05 05:13:45 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:45 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da" returned: 0 in 0.815s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:45 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da Jul 05 05:13:45 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:46 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec999998-3b72-4f55-85c6-1c3b677ad0da" returned: 0 in 0.737s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-ec999998-3b72-4f55-85c6-1c3b677ad0da" released by "delete_volume" :: held 1.599s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Created reservations ['2e6114fa-1c22-4e27-9f01-1d549e2010f2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:46 devstack cinder-volume[86688]: WARNING cinder.quota [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-315747323 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-315747323, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:13:46 devstack cinder-volume[86688]: WARNING cinder.quota [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-315747323 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-315747323, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Created reservations ['c5be3ae4-b621-46c2-9c0d-f48456a6b042', 'b3c26272-299f-4363-b7d2-84c4d0bbe6d6', '3de060f3-b883-4a1c-97ff-e75c49040300', '0eaa3b9d-2cda-4040-ac37-863e67d2e25a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:46 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:13:46 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:47 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.942s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:47 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:13:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-937fcf37-6005-4157-ae61-9f680b69b9ca tempest-GroupsV314Test-1186870175 None] Delete group completed successfully. Jul 05 05:13:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Acquiring lock "cinder-quobyte-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:13:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" acquired by "delete_volume" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:13:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcc2147-3fc7-431d-8efe-5ee3b6beca9a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:13:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:48 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 Jul 05 05:13:48 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:48 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" returned: 0 in 0.870s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:48 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1 Jul 05 05:13:48 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:49 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" returned: 0 in 0.767s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Lock "cinder-quobyte-4dbdbed3-bc2a-47fd-8e19-31fc4547c2a1" released by "delete_volume" :: held 1.735s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Created reservations ['23e04293-8c31-4fb5-b412-542d667beff4'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Created reservations ['9ea4dddb-633a-4f95-84c1-6b80d2ac3d05', 'b0ab5e08-d032-4367-8b27-f6aa6f1d998b', '0b701ebf-cc82-4ea8-a792-b480e7e5ff88', '73586aa8-8c2a-4e69-91f5-7086121b96af'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:13:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:13:49 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:13:49 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:13:51 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 05 05:13:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.338s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:13:51 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:13:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-02adbb50-a88b-4cab-9d3a-011fffd7aca3 tempest-GroupsV314Test-1186870175 None] Delete group completed successfully. Jul 05 05:13:59 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:INSERT=8,cinder:UPDATE=32,cinder:SELECT=18 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:13:59 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=44,cinder:UPDATE=37,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Flow 'volume_create_manager' (abce1b53-ac20-4879-9369-ba1b93131889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d744a1a-14db-4956-bf4a-4e25c1494617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d744a1a-14db-4956-bf4a-4e25c1494617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1242827321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83217c06-22f8-40f5-99e5-10858416c9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3f6290c2264472a350a370b092a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:09Z,use_quota=True,user_id='34a76abe0bb74c2fb6086e1749629b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9af72c1-6d09-41fe-b6c1-f63719a31619),volume_type_id=c9af72c1-6d09-41fe-b6c1-f63719a31619)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997b3d05-c8c6-4768-acfa-bca941c98d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (997b3d05-c8c6-4768-acfa-bca941c98d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b63b34-04a4-436a-ab6d-59e62bcebfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b63b34-04a4-436a-ab6d-59e62bcebfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83217c06-22f8-40f5-99e5-10858416c9cd', 'volume_name': 'volume-83217c06-22f8-40f5-99e5-10858416c9cd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ac1de-0d31-4278-b0e6-c9c4eec2d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13ac1de-0d31-4278-b0e6-c9c4eec2d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f791e34a-e213-44a5-a745-c3c089b25684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:08 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Volume 83217c06-22f8-40f5-99e5-10858416c9cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83217c06-22f8-40f5-99e5-10858416c9cd', 'volume_size': 1} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1242827321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83217c06-22f8-40f5-99e5-10858416c9cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d3f6290c2264472a350a370b092a430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:09Z,use_quota=True,user_id='34a76abe0bb74c2fb6086e1749629b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9af72c1-6d09-41fe-b6c1-f63719a31619),volume_type_id=c9af72c1-6d09-41fe-b6c1-f63719a31619)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Creating volume 83217c06-22f8-40f5-99e5-10858416c9cd {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:14:08 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:14:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:08 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd 1073741824 Jul 05 05:14:08 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:09 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd 1073741824" returned: 0 in 0.932s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:09 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd Jul 05 05:14:09 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:10 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd" returned: 0 in 0.744s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:14:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f791e34a-e213-44a5-a745-c3c089b25684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83217c06-22f8-40f5-99e5-10858416c9cd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66713b13-33c7-4590-b685-09f8c32794f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:10 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Volume volume-83217c06-22f8-40f5-99e5-10858416c9cd (83217c06-22f8-40f5-99e5-10858416c9cd): created successfully Jul 05 05:14:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66713b13-33c7-4590-b685-09f8c32794f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Flow 'volume_create_manager' (abce1b53-ac20-4879-9369-ba1b93131889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d4d495bc-ca7e-40dc-9540-7e0dce7381da tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Created volume successfully. Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:11 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:11 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:11 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:11 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:14:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bceb410f-71ab-464a-a777-cc3cf3d76590 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Retype volume completed successfully. Jul 05 05:14:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Acquiring lock "cinder-83217c06-22f8-40f5-99e5-10858416c9cd-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "cinder-83217c06-22f8-40f5-99e5-10858416c9cd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Acquiring lock "cinder-quobyte-83217c06-22f8-40f5-99e5-10858416c9cd" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "cinder-quobyte-83217c06-22f8-40f5-99e5-10858416c9cd" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[84240ce0-74e8-435c-a12f-9b6e5f939376]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:14:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:12 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd Jul 05 05:14:12 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:13 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd" returned: 0 in 0.807s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:13 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd Jul 05 05:14:13 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:14 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-83217c06-22f8-40f5-99e5-10858416c9cd" returned: 0 in 0.652s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "cinder-quobyte-83217c06-22f8-40f5-99e5-10858416c9cd" released by "delete_volume" :: held 1.509s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:14 devstack cinder-volume[86688]: WARNING cinder.quota [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:14:14 devstack cinder-volume[86688]: WARNING cinder.quota [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Created reservations ['540deea4-0142-43ce-850a-9935e301816f', 'eb298b50-4b66-4e88-84b9-20021fcc0bd2', 'ff462f76-1f80-404d-a59c-c610bc5827ed', '592f2c41-cbd3-475e-ab16-e2a1a3732a1c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:14 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:14 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:15 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.789s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:15 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:14:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Deleted volume successfully. Jul 05 05:14:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44fb5293-2edf-4ae2-a063-299f887819e8 tempest-VolumeRetypeWithoutMigrationTest-282141019 None] Lock "cinder-83217c06-22f8-40f5-99e5-10858416c9cd-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Flow 'volume_create_manager' (d589995e-7575-4394-b0bc-45ac3f8505ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc6a66a-b23a-44cb-8e28-ba2319fde3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc6a66a-b23a-44cb-8e28-ba2319fde3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2124744476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3ec179-93b0-4404-be6e-84d55f23a99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b13419ecd51497b99bd68ac152d418a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:21Z,use_quota=True,user_id='e3bc74eefdef4fe2a59c17ef0eedaf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca1c57f-2be8-490a-b945-133b38505013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca1c57f-2be8-490a-b945-133b38505013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d59009f-41fe-4b68-9a18-e0e944a66757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d59009f-41fe-4b68-9a18-e0e944a66757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3ec179-93b0-4404-be6e-84d55f23a99e', 'volume_name': 'volume-4b3ec179-93b0-4404-be6e-84d55f23a99e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0b7e84-92a3-4aae-a8f1-d774177d80d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0b7e84-92a3-4aae-a8f1-d774177d80d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78869ed9-2b58-44cb-9b41-2634ea9e1f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Volume 4b3ec179-93b0-4404-be6e-84d55f23a99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3ec179-93b0-4404-be6e-84d55f23a99e', 'volume_size': 1} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2124744476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3ec179-93b0-4404-be6e-84d55f23a99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b13419ecd51497b99bd68ac152d418a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:21Z,use_quota=True,user_id='e3bc74eefdef4fe2a59c17ef0eedaf7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Creating volume 4b3ec179-93b0-4404-be6e-84d55f23a99e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:14:21 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:14:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:21 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e 1073741824 Jul 05 05:14:21 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:22 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e 1073741824" returned: 0 in 1.029s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:22 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e Jul 05 05:14:22 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:23 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e" returned: 0 in 0.740s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78869ed9-2b58-44cb-9b41-2634ea9e1f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3ec179-93b0-4404-be6e-84d55f23a99e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a9cca5-bbd5-4eb5-9397-34c0350d229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Volume volume-4b3ec179-93b0-4404-be6e-84d55f23a99e (4b3ec179-93b0-4404-be6e-84d55f23a99e): created successfully Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a9cca5-bbd5-4eb5-9397-34c0350d229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Flow 'volume_create_manager' (d589995e-7575-4394-b0bc-45ac3f8505ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a2bc4d40-7e28-4b5b-b405-9c3eb9f15148 tempest-VolumesServicesTestJSON-479403669 None] Created volume successfully. Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Acquiring lock "cinder-4b3ec179-93b0-4404-be6e-84d55f23a99e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Lock "cinder-4b3ec179-93b0-4404-be6e-84d55f23a99e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Acquiring lock "cinder-quobyte-4b3ec179-93b0-4404-be6e-84d55f23a99e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Lock "cinder-quobyte-4b3ec179-93b0-4404-be6e-84d55f23a99e" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b7f3dc-3806-4b0f-9f8f-44c3b0989cea]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:14:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:24 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e Jul 05 05:14:24 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:25 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e" returned: 0 in 1.222s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:25 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e Jul 05 05:14:25 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:26 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4b3ec179-93b0-4404-be6e-84d55f23a99e" returned: 0 in 0.856s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Lock "cinder-quobyte-4b3ec179-93b0-4404-be6e-84d55f23a99e" released by "delete_volume" :: held 2.163s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Created reservations ['e83069bc-be5e-4f09-adae-c25d77f59636', 'f0096002-727b-4333-b90d-717696d24800', '8d7ac21f-344b-455a-9142-f1aef1c1fc0d', '23780e71-b485-47c5-86bd-99800a765ec2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:26 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:26 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:27 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.811s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:27 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:14:27 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Deleted volume successfully. Jul 05 05:14:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f864daed-6e2e-499d-b990-7b3e932102d2 tempest-VolumesServicesTestJSON-479403669 None] Lock "cinder-4b3ec179-93b0-4404-be6e-84d55f23a99e-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-5abe44dd-d620-44a6-a573-0dea96b5d9ed req-bb9d02b5-2bf3-4dee-89c7-2e2c560dc18e tempest-AttachVolumeNegativeTest-1383062054 None] Terminate volume connection completed successfully. Jul 05 05:14:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-5abe44dd-d620-44a6-a573-0dea96b5d9ed req-bb9d02b5-2bf3-4dee-89c7-2e2c560dc18e tempest-AttachVolumeNegativeTest-1383062054 None] Deleting attachment f96f1bfc-a0a4-4f02-badf-73fa46a0b644. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:14:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:14:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:30 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:30 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:31 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.075s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:14:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:14:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 8 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:14:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:14:36 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:14:39 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Flow 'volume_create_manager' (59f1ae79-f01f-413c-9791-48358fd89c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96d4c80-83a8-4077-9bee-2db7c4c224f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96d4c80-83a8-4077-9bee-2db7c4c224f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-877093816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d10c3e-e7fa-41ee-a1eb-00b288c23543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59e9ac53264cf8930ef20cd4570ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:40Z,use_quota=True,user_id='087c2289fe194ae9ac394e2a8c294107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bc2c4f-222e-4b4a-b097-c15e6d1a69f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bc2c4f-222e-4b4a-b097-c15e6d1a69f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7119e985-b2a0-4bfa-90a8-58e99fae6182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7119e985-b2a0-4bfa-90a8-58e99fae6182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d10c3e-e7fa-41ee-a1eb-00b288c23543', 'volume_name': 'volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5e169d-01b3-4271-9447-529f2cbaf0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5e169d-01b3-4271-9447-529f2cbaf0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576af0cf-b8ca-4fdf-be5e-26ec1bffcbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:40 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Volume e9d10c3e-e7fa-41ee-a1eb-00b288c23543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543', 'volume_size': 1} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-877093816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d10c3e-e7fa-41ee-a1eb-00b288c23543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59e9ac53264cf8930ef20cd4570ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:40Z,use_quota=True,user_id='087c2289fe194ae9ac394e2a8c294107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Creating volume e9d10c3e-e7fa-41ee-a1eb-00b288c23543 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:14:40 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:14:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:40 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 1073741824 Jul 05 05:14:40 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:41 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 1073741824" returned: 0 in 0.865s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:41 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 Jul 05 05:14:41 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:42 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543" returned: 0 in 0.645s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:14:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576af0cf-b8ca-4fdf-be5e-26ec1bffcbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668d0191-2822-462e-b825-ad07baf91479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Volume volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 (e9d10c3e-e7fa-41ee-a1eb-00b288c23543): created successfully Jul 05 05:14:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668d0191-2822-462e-b825-ad07baf91479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Flow 'volume_create_manager' (59f1ae79-f01f-413c-9791-48358fd89c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8afd3fd7-0e01-4462-a739-e17ea1fd5e68 tempest-VolumesListAdminTestJSON-615495707 None] Created volume successfully. Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Flow 'volume_create_manager' (be0251a8-408c-4bf6-9d99-407de58518a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf259da-62b9-45a6-8e16-0359a9497b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bf259da-62b9-45a6-8e16-0359a9497b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2000963704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c331c22b-43c0-43fb-8c04-84df3d37a2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59e9ac53264cf8930ef20cd4570ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:43Z,use_quota=True,user_id='087c2289fe194ae9ac394e2a8c294107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1530a5a8-549a-45ad-a5b0-e925921e0544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1530a5a8-549a-45ad-a5b0-e925921e0544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50ef5ee-a626-480a-bcae-21e70bb033b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50ef5ee-a626-480a-bcae-21e70bb033b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c331c22b-43c0-43fb-8c04-84df3d37a2c0', 'volume_name': 'volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3311e437-81c4-427f-a6b0-a6bbdf3cf9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3311e437-81c4-427f-a6b0-a6bbdf3cf9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2488a9f-038d-4790-bc15-6232e62f5e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:43 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Volume c331c22b-43c0-43fb-8c04-84df3d37a2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0', 'volume_size': 1} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2000963704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c331c22b-43c0-43fb-8c04-84df3d37a2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59e9ac53264cf8930ef20cd4570ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:43Z,use_quota=True,user_id='087c2289fe194ae9ac394e2a8c294107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Creating volume c331c22b-43c0-43fb-8c04-84df3d37a2c0 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:14:43 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:14:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:43 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 1073741824 Jul 05 05:14:43 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:44 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 1073741824" returned: 0 in 0.868s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:44 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 Jul 05 05:14:44 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:44 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0" returned: 0 in 0.669s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2488a9f-038d-4790-bc15-6232e62f5e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff6824f-fb66-4166-8b49-a12d741829af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:44 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Volume volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 (c331c22b-43c0-43fb-8c04-84df3d37a2c0): created successfully Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff6824f-fb66-4166-8b49-a12d741829af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Flow 'volume_create_manager' (be0251a8-408c-4bf6-9d99-407de58518a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-266ec35e-cfec-44eb-9820-e8609ee83d6b tempest-VolumesListAdminTestJSON-615495707 None] Created volume successfully. Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Flow 'volume_create_manager' (e6c1ccb3-a1a9-44db-aeb0-46e0e541676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726bef05-2121-4aa6-ba20-ce1fd416421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726bef05-2121-4aa6-ba20-ce1fd416421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2083712842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce28cc0-695e-427a-823c-f7937df98217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59e9ac53264cf8930ef20cd4570ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:46Z,use_quota=True,user_id='087c2289fe194ae9ac394e2a8c294107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b03c692-2712-42ac-b5bc-5a59c03b7458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b03c692-2712-42ac-b5bc-5a59c03b7458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d60409-32a5-40aa-95e2-040d6c917bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d60409-32a5-40aa-95e2-040d6c917bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce28cc0-695e-427a-823c-f7937df98217', 'volume_name': 'volume-dce28cc0-695e-427a-823c-f7937df98217', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430212d6-2548-4aa4-b575-2b1294963370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430212d6-2548-4aa4-b575-2b1294963370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfef8b6-bf8f-47ad-bb17-7038014a2def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:45 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Volume dce28cc0-695e-427a-823c-f7937df98217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce28cc0-695e-427a-823c-f7937df98217', 'volume_size': 1} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2083712842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce28cc0-695e-427a-823c-f7937df98217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d59e9ac53264cf8930ef20cd4570ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:46Z,use_quota=True,user_id='087c2289fe194ae9ac394e2a8c294107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Creating volume dce28cc0-695e-427a-823c-f7937df98217 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:14:45 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:14:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:45 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 1073741824 Jul 05 05:14:45 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:46 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 1073741824" returned: 0 in 0.854s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:46 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 Jul 05 05:14:46 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:47 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217" returned: 0 in 0.634s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:14:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfef8b6-bf8f-47ad-bb17-7038014a2def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce28cc0-695e-427a-823c-f7937df98217', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed54bd4-4ebc-4e1d-8a58-6d8348e40bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:47 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Volume volume-dce28cc0-695e-427a-823c-f7937df98217 (dce28cc0-695e-427a-823c-f7937df98217): created successfully Jul 05 05:14:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed54bd4-4ebc-4e1d-8a58-6d8348e40bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Flow 'volume_create_manager' (e6c1ccb3-a1a9-44db-aeb0-46e0e541676f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4cec69c9-c8ed-4ae4-829a-6a22e2bf024e tempest-VolumesListAdminTestJSON-615495707 None] Created volume successfully. Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Flow 'volume_create_manager' (b0f22f85-852c-46e8-8f1f-f3c00485b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b147005c-4422-4519-afb4-215e727811d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b147005c-4422-4519-afb4-215e727811d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114eb886-8cb1-4c46-b13b-749bc9a6978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568a875a608e4129b853dc2dcd73b55e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:48Z,use_quota=True,user_id='4cc8cce565a240c494cb1cfc6165f3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78427bd-df90-4a15-9d8b-a13a00e5ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78427bd-df90-4a15-9d8b-a13a00e5ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b67ab7-85df-44ac-8a87-5cd415960f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b67ab7-85df-44ac-8a87-5cd415960f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114eb886-8cb1-4c46-b13b-749bc9a6978d', 'volume_name': 'volume-114eb886-8cb1-4c46-b13b-749bc9a6978d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02110e0b-5ace-4987-8ddf-acc5cf6790d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02110e0b-5ace-4987-8ddf-acc5cf6790d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7ee584-5edb-45d9-bdda-6916e0d81c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:48 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Volume 114eb886-8cb1-4c46-b13b-749bc9a6978d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114eb886-8cb1-4c46-b13b-749bc9a6978d', 'volume_size': 1} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114eb886-8cb1-4c46-b13b-749bc9a6978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568a875a608e4129b853dc2dcd73b55e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:48Z,use_quota=True,user_id='4cc8cce565a240c494cb1cfc6165f3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Creating volume 114eb886-8cb1-4c46-b13b-749bc9a6978d {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:14:48 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:14:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:48 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d 1073741824 Jul 05 05:14:48 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:49 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d 1073741824" returned: 0 in 1.024s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:49 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d Jul 05 05:14:49 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Flow 'volume_create_manager' (2d728cee-ea62-4fa1-a41b-53f4e7dafe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965f79d0-50c1-46d0-b07a-d1b0aea100f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965f79d0-50c1-46d0-b07a-d1b0aea100f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-80739208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9c9ba0-d6d1-41c3-9b4c-b56b173392d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188f1a418f04409496a598c5a1daba26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:50Z,use_quota=True,user_id='21b1893a725540fa85f88741d69f222e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0827eaba-b4c8-42f8-8916-10f6ecccff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0827eaba-b4c8-42f8-8916-10f6ecccff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3451455d-bd3e-4f6c-8a9d-23766391db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3451455d-bd3e-4f6c-8a9d-23766391db0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9c9ba0-d6d1-41c3-9b4c-b56b173392d1', 'volume_name': 'volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1792c756-008b-4e99-b2cf-644ddc938ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1792c756-008b-4e99-b2cf-644ddc938ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7b345d-2933-418a-a93b-5fd349826af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Volume da9c9ba0-d6d1-41c3-9b4c-b56b173392d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1', 'volume_size': 1} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:50 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d" returned: 0 in 0.750s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-80739208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9c9ba0-d6d1-41c3-9b4c-b56b173392d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188f1a418f04409496a598c5a1daba26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:14:50Z,use_quota=True,user_id='21b1893a725540fa85f88741d69f222e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Creating volume da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:14:50 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7ee584-5edb-45d9-bdda-6916e0d81c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114eb886-8cb1-4c46-b13b-749bc9a6978d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5085dcc1-0cb3-45f3-a0e5-4648605de59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:50 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 1073741824 Jul 05 05:14:50 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Volume volume-114eb886-8cb1-4c46-b13b-749bc9a6978d (114eb886-8cb1-4c46-b13b-749bc9a6978d): created successfully Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5085dcc1-0cb3-45f3-a0e5-4648605de59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Flow 'volume_create_manager' (b0f22f85-852c-46e8-8f1f-f3c00485b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-eb962309-7509-4b52-b9ca-c4a738813b31 tempest-VolumesListAdminTestJSON-1200604666 None] Created volume successfully. Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Acquiring lock "cinder-114eb886-8cb1-4c46-b13b-749bc9a6978d-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "cinder-114eb886-8cb1-4c46-b13b-749bc9a6978d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Acquiring lock "cinder-quobyte-114eb886-8cb1-4c46-b13b-749bc9a6978d" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "cinder-quobyte-114eb886-8cb1-4c46-b13b-749bc9a6978d" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a30d2-a5c8-4cdb-90a9-4eb91fd7fa7c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "cinder-dce28cc0-695e-427a-823c-f7937df98217-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-dce28cc0-695e-427a-823c-f7937df98217-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "cinder-quobyte-dce28cc0-695e-427a-823c-f7937df98217" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-quobyte-dce28cc0-695e-427a-823c-f7937df98217" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:50 devstack sudo[92553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d Jul 05 05:14:50 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80147fe-232f-4f67-8da7-e78ce0af6309]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:51 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 Jul 05 05:14:51 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:51 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 1073741824" returned: 0 in 0.982s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:51 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 Jul 05 05:14:51 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:51 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d" returned: 0 in 0.980s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:51 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d Jul 05 05:14:51 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:51 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217" returned: 0 in 0.886s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:51 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217 Jul 05 05:14:51 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:52 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1" returned: 0 in 0.798s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7b345d-2933-418a-a93b-5fd349826af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd92824-3555-41b6-bf04-d0b0dea145ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:14:52 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Volume volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 (da9c9ba0-d6d1-41c3-9b4c-b56b173392d1): created successfully Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd92824-3555-41b6-bf04-d0b0dea145ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Flow 'volume_create_manager' (2d728cee-ea62-4fa1-a41b-53f4e7dafe3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:14:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8c2f15fc-5fa2-46a2-9d29-faa126420b36 tempest-AttachVolumeShelveTestJSON-783305089 None] Created volume successfully. Jul 05 05:14:52 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-114eb886-8cb1-4c46-b13b-749bc9a6978d" returned: 0 in 0.716s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "cinder-quobyte-114eb886-8cb1-4c46-b13b-749bc9a6978d" released by "delete_volume" :: held 1.740s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Created reservations ['c9454bf8-ab0e-4b97-927f-fa3bde87fe4d', '65fbcad6-38e9-487e-ba4f-66f7f94e4209', 'bff4b9ec-784d-47d9-b6db-8cbf009e0560', '5296b667-608d-4eb7-a1dd-8304213c3e08'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:14:52 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dce28cc0-695e-427a-823c-f7937df98217" returned: 0 in 0.714s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-quobyte-dce28cc0-695e-427a-823c-f7937df98217" released by "delete_volume" :: held 1.652s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:52 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:52 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Created reservations ['7f85b22b-7e69-4eca-95ed-be56004018d0', 'f082d9bc-0ccd-4b9e-8232-2b7889e61ae8', 'f7b5783b-8a22-4103-b3b9-8b640b20e5d9', '6993fb72-5fbe-4acf-a08e-b5fd5a438a91'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:52 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:52 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "cinder-c331c22b-43c0-43fb-8c04-84df3d37a2c0-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-c331c22b-43c0-43fb-8c04-84df3d37a2c0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "cinder-quobyte-c331c22b-43c0-43fb-8c04-84df3d37a2c0" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-quobyte-c331c22b-43c0-43fb-8c04-84df3d37a2c0" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb67556-3d14-49c0-8c4e-91d1d71f3040]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:14:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:53 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 Jul 05 05:14:53 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:54 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.306s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:14:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Deleted volume successfully. Jul 05 05:14:54 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.245s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:14:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Deleted volume successfully. Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ad7bcab-2b57-4d2d-a417-ca3b04cc7c57 tempest-VolumesListAdminTestJSON-1200604666 None] Lock "cinder-114eb886-8cb1-4c46-b13b-749bc9a6978d-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-046bf9e4-3d6d-4eb2-a0a2-a3312c0ae46b tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-dce28cc0-695e-427a-823c-f7937df98217-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:54 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0" returned: 0 in 1.157s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:54 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0 Jul 05 05:14:54 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:55 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c331c22b-43c0-43fb-8c04-84df3d37a2c0" returned: 0 in 0.755s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-quobyte-c331c22b-43c0-43fb-8c04-84df3d37a2c0" released by "delete_volume" :: held 2.031s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Created reservations ['41db8947-3f08-4124-a7d3-5556367737e8', 'eef59a45-53a4-4fd8-88ed-0a28400c6685', 'd5c30c80-26a9-4d99-ae36-8228d93f9f60', '0530d098-c6d0-4150-ac83-b4f44e857362'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:55 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:55 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:56 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.660s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:56 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:14:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Deleted volume successfully. Jul 05 05:14:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aac44c3a-e79c-4289-9b65-b76b08b6db78 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-c331c22b-43c0-43fb-8c04-84df3d37a2c0-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "cinder-e9d10c3e-e7fa-41ee-a1eb-00b288c23543-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-e9d10c3e-e7fa-41ee-a1eb-00b288c23543-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "cinder-quobyte-e9d10c3e-e7fa-41ee-a1eb-00b288c23543" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:14:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-quobyte-e9d10c3e-e7fa-41ee-a1eb-00b288c23543" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:14:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[15440761-5e4e-4b3c-9228-aeb61365d9b8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:14:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:57 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 Jul 05 05:14:57 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:58 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543" returned: 0 in 0.983s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:58 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543 Jul 05 05:14:58 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:14:58 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e9d10c3e-e7fa-41ee-a1eb-00b288c23543" returned: 0 in 0.701s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-quobyte-e9d10c3e-e7fa-41ee-a1eb-00b288c23543" released by "delete_volume" :: held 1.748s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Created reservations ['13ccf430-600e-405e-b894-d3aa00447cfb', 'ea1df261-ba3a-4e50-880d-354beb98586f', '6c8be3c3-acfe-4a1b-b077-c5330f44cc01', 'db8c9afb-9fdc-4d98-b122-b29c16908e16'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:14:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:14:59 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:14:59 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:00 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.192s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:00 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:15:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Deleted volume successfully. Jul 05 05:15:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd446b0f-8a30-44a8-86f8-63ebe8a27dd0 tempest-VolumesListAdminTestJSON-615495707 None] Lock "cinder-e9d10c3e-e7fa-41ee-a1eb-00b288c23543-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:08 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=45,cinder:DELETE=6 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Flow 'volume_create_manager' (2d756a34-5a47-41b4-a05f-bfceebebcf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67babc78-9402-4f56-8fcf-8f775f725e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67babc78-9402-4f56-8fcf-8f775f725e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1159113618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb60661-7a66-4313-b7e5-a99da58c0427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c83625d42f4c3da1ec2b6bd89e3881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:09Z,use_quota=True,user_id='c0dcdd5d11e2412e8a2bd33c171f08b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e137c23d-353b-4fce-ae04-13a714277587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e137c23d-353b-4fce-ae04-13a714277587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dc87ba-0f0c-4e93-a4f4-45ce73132919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dc87ba-0f0c-4e93-a4f4-45ce73132919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb60661-7a66-4313-b7e5-a99da58c0427', 'volume_name': 'volume-fdb60661-7a66-4313-b7e5-a99da58c0427', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78df2015-818e-48b2-9dec-f8b9462eff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78df2015-818e-48b2-9dec-f8b9462eff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06d1509-e3b8-4e0c-a665-c9904fd0d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Volume fdb60661-7a66-4313-b7e5-a99da58c0427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb60661-7a66-4313-b7e5-a99da58c0427', 'volume_size': 1} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1159113618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb60661-7a66-4313-b7e5-a99da58c0427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c83625d42f4c3da1ec2b6bd89e3881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:09Z,use_quota=True,user_id='c0dcdd5d11e2412e8a2bd33c171f08b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Creating volume fdb60661-7a66-4313-b7e5-a99da58c0427 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:15:09 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:15:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:09 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 1073741824 Jul 05 05:15:09 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:10 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 1073741824" returned: 0 in 0.986s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:10 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 Jul 05 05:15:10 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:11 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427" returned: 0 in 0.723s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06d1509-e3b8-4e0c-a665-c9904fd0d92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb60661-7a66-4313-b7e5-a99da58c0427', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64088355-f352-48da-9d40-04587e0690db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-e7e561cc-f776-4edd-9964-04b7fa1bf9aa req-699a6057-f5aa-4400-a3f6-f3b2736bd96e tempest-AttachVolumeShelveTestJSON-783305089 None] No connector for attachment 917674bf-00cb-4ab1-b6be-b63f985188e5; skipping storage backend terminate_connection call. {{(pid=86688) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-e7e561cc-f776-4edd-9964-04b7fa1bf9aa req-699a6057-f5aa-4400-a3f6-f3b2736bd96e tempest-AttachVolumeShelveTestJSON-783305089 None] Deleting attachment 917674bf-00cb-4ab1-b6be-b63f985188e5. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:15:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Volume volume-fdb60661-7a66-4313-b7e5-a99da58c0427 (fdb60661-7a66-4313-b7e5-a99da58c0427): created successfully Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64088355-f352-48da-9d40-04587e0690db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Flow 'volume_create_manager' (2d756a34-5a47-41b4-a05f-bfceebebcf3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3012f844-abc5-40e5-b644-086371c0a828 tempest-AbsoluteLimitsTests-1639104857 None] Created volume successfully. Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Acquiring lock "cinder-fdb60661-7a66-4313-b7e5-a99da58c0427-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Lock "cinder-fdb60661-7a66-4313-b7e5-a99da58c0427-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Acquiring lock "cinder-quobyte-fdb60661-7a66-4313-b7e5-a99da58c0427" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Lock "cinder-quobyte-fdb60661-7a66-4313-b7e5-a99da58c0427" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d47cce1-e162-42fd-877c-d4439a94f410]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:11 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 Jul 05 05:15:11 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:12 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427" returned: 0 in 0.814s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:12 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427 Jul 05 05:15:12 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:13 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fdb60661-7a66-4313-b7e5-a99da58c0427" returned: 0 in 0.662s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Lock "cinder-quobyte-fdb60661-7a66-4313-b7e5-a99da58c0427" released by "delete_volume" :: held 1.514s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Created reservations ['edae3634-908e-43d0-9bf6-9972d5b138b0', '1d832922-ae54-49ac-b2ce-ae0ba9fcb7ea', '6756ac2c-eae0-48da-9272-596190d9d61b', '15ef511b-eee0-471c-af00-ed28291925f5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:13 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:15:13 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:14 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.684s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:14 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:15:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Deleted volume successfully. Jul 05 05:15:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d73de78-721e-48f1-a7ee-01e14810bab2 tempest-AbsoluteLimitsTests-1639104857 None] Lock "cinder-fdb60661-7a66-4313-b7e5-a99da58c0427-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Flow 'volume_create_manager' (b2b2282d-d010-456c-b1c3-8b128313b750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1ecce0-bc07-4f06-994e-5533e836df89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1ecce0-bc07-4f06-994e-5533e836df89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1796259744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c5003a-220a-4817-9014-6825bacddfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563c830dab604603b6184671d67047b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:18Z,use_quota=True,user_id='46474c909cf8453ba5100da330add926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b82939-2e5a-45e6-86b5-65e7cc5f2aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b82939-2e5a-45e6-86b5-65e7cc5f2aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c411c70a-f346-4a10-b993-b1ed05b5c3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c411c70a-f346-4a10-b993-b1ed05b5c3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c5003a-220a-4817-9014-6825bacddfae', 'volume_name': 'volume-76c5003a-220a-4817-9014-6825bacddfae', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dd1822-1962-43a8-8197-3fd2f6477cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dd1822-1962-43a8-8197-3fd2f6477cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b39da46-a11e-4a9c-9f8d-8d3bd0f93e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:18 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Volume 76c5003a-220a-4817-9014-6825bacddfae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c5003a-220a-4817-9014-6825bacddfae', 'volume_size': 1} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1796259744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c5003a-220a-4817-9014-6825bacddfae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='563c830dab604603b6184671d67047b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:18Z,use_quota=True,user_id='46474c909cf8453ba5100da330add926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Creating volume 76c5003a-220a-4817-9014-6825bacddfae {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:15:18 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:15:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:18 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae 1073741824 Jul 05 05:15:18 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:19 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae 1073741824" returned: 0 in 1.028s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:19 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae Jul 05 05:15:19 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:20 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae" returned: 0 in 0.674s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b39da46-a11e-4a9c-9f8d-8d3bd0f93e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c5003a-220a-4817-9014-6825bacddfae', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0383f8-1bf0-490c-aaaf-194b8e1fa63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Volume volume-76c5003a-220a-4817-9014-6825bacddfae (76c5003a-220a-4817-9014-6825bacddfae): created successfully Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0383f8-1bf0-490c-aaaf-194b8e1fa63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Flow 'volume_create_manager' (b2b2282d-d010-456c-b1c3-8b128313b750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:20 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e2604686-9589-499b-a597-9a047d64dd95 tempest-VolumesMetadataTest-1644124461 None] Created volume successfully. Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Flow 'volume_create_manager' (cc962358-7a35-4616-8ea8-78baa0314a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0591411d-63a6-44fc-87c6-be9bd7711ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0591411d-63a6-44fc-87c6-be9bd7711ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-379427151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d6ce40-465f-43fe-9ae9-3b6e121589bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9eaa9d72de248fab142f3502eb748a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:21Z,use_quota=True,user_id='08e02411f33840e6b399edaea94ff619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0643d0-09e0-4767-9b94-51828bc79e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0643d0-09e0-4767-9b94-51828bc79e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2534807a-7696-4a6a-9a67-d79c1cc95285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2534807a-7696-4a6a-9a67-d79c1cc95285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d6ce40-465f-43fe-9ae9-3b6e121589bd', 'volume_name': 'volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3507ea0d-bea4-47fb-92b9-e94f4fdb1b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3507ea0d-bea4-47fb-92b9-e94f4fdb1b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b307aeeb-86b8-49dc-beb3-735c55aa96bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Volume 43d6ce40-465f-43fe-9ae9-3b6e121589bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd', 'volume_size': 1} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-379427151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d6ce40-465f-43fe-9ae9-3b6e121589bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9eaa9d72de248fab142f3502eb748a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:21Z,use_quota=True,user_id='08e02411f33840e6b399edaea94ff619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Creating volume 43d6ce40-465f-43fe-9ae9-3b6e121589bd {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:15:20 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:15:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:20 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd 1073741824 Jul 05 05:15:20 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Acquiring lock "cinder-76c5003a-220a-4817-9014-6825bacddfae-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Lock "cinder-76c5003a-220a-4817-9014-6825bacddfae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Acquiring lock "cinder-quobyte-76c5003a-220a-4817-9014-6825bacddfae" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Lock "cinder-quobyte-76c5003a-220a-4817-9014-6825bacddfae" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b79bdc6-cd2f-4f57-b437-d93ebb1afebe]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:21 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae Jul 05 05:15:21 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:21 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd 1073741824" returned: 0 in 0.908s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:21 devstack sudo[92785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd Jul 05 05:15:21 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:22 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae" returned: 0 in 1.075s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:22 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae Jul 05 05:15:22 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:22 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd" returned: 0 in 0.934s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b307aeeb-86b8-49dc-beb3-735c55aa96bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487b03a1-568f-4ce1-bfa2-45c0d1c71cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:22 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Volume volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd (43d6ce40-465f-43fe-9ae9-3b6e121589bd): created successfully Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487b03a1-568f-4ce1-bfa2-45c0d1c71cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Flow 'volume_create_manager' (cc962358-7a35-4616-8ea8-78baa0314a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-025f1cd5-abdf-4784-92b9-4f3ea7766bdf tempest-AttachVolumeNegativeTest-1383062054 None] Created volume successfully. Jul 05 05:15:23 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-76c5003a-220a-4817-9014-6825bacddfae" returned: 0 in 0.789s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Lock "cinder-quobyte-76c5003a-220a-4817-9014-6825bacddfae" released by "delete_volume" :: held 1.929s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Created reservations ['94017ea3-3799-4975-ac20-5ce3a00c4a0e', 'babb5ff3-e753-459f-acfd-cf60c7a62981', '38469f68-5311-422e-b733-d64022661ed1', 'f2c7918a-055a-416a-8e3d-866a483221c0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:23 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:15:23 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:24 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.800s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:24 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:15:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Deleted volume successfully. Jul 05 05:15:24 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-555231a6-69ec-4257-b664-575f2765cb62 tempest-VolumesMetadataTest-1644124461 None] Lock "cinder-76c5003a-220a-4817-9014-6825bacddfae-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Flow 'volume_create_manager' (d1646e8a-67d5-42bb-8a5f-bc5ac6707d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b61733-02e9-49b7-9f24-8715ca5743dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b61733-02e9-49b7-9f24-8715ca5743dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1499159183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbd52f0-45ee-4104-a45c-4fca14e9e18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8d960f6e94e128125fb267c2ac8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:27Z,use_quota=True,user_id='753d8a82448140818d9cf73a2f43a17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aafaf2-e861-41a9-9de7-1c5eca60acfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aafaf2-e861-41a9-9de7-1c5eca60acfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1ed77-a012-48f5-9948-d906929d03d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1ed77-a012-48f5-9948-d906929d03d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbd52f0-45ee-4104-a45c-4fca14e9e18d', 'volume_name': 'volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6162147d-89e5-480f-af3f-a77fd555840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6162147d-89e5-480f-af3f-a77fd555840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7345c4e-671a-4048-afe7-5226ac89851a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:27 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Volume 1dbd52f0-45ee-4104-a45c-4fca14e9e18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d', 'volume_size': 1} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1499159183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbd52f0-45ee-4104-a45c-4fca14e9e18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8d960f6e94e128125fb267c2ac8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:27Z,use_quota=True,user_id='753d8a82448140818d9cf73a2f43a17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Creating volume 1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:15:27 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:27 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d 1073741824 Jul 05 05:15:27 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-13465f0d-223c-4b9f-9014-41286abdfce6 req-bddc1d5f-26bf-4958-96fa-a47cc87d74c4 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:28 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d 1073741824" returned: 0 in 0.859s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:28 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d Jul 05 05:15:28 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:28 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" returned: 0 in 0.647s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-13465f0d-223c-4b9f-9014-41286abdfce6 req-bddc1d5f-26bf-4958-96fa-a47cc87d74c4 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.586s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7345c4e-671a-4048-afe7-5226ac89851a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c696df9-8c23-4368-89eb-884f30f4e76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc54e40-3511-49ca-b523-58d5fa4cb861]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-13465f0d-223c-4b9f-9014-41286abdfce6 req-bddc1d5f-26bf-4958-96fa-a47cc87d74c4 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:28 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Volume volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d (1dbd52f0-45ee-4104-a45c-4fca14e9e18d): created successfully Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c696df9-8c23-4368-89eb-884f30f4e76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Flow 'volume_create_manager' (d1646e8a-67d5-42bb-8a5f-bc5ac6707d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c8c0e546-2cfa-4db5-b010-4dd2da9168b1 tempest-VolumesCloneTest-1470368385 None] Created volume successfully. Jul 05 05:15:29 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd Jul 05 05:15:29 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:29 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:15:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Flow 'volume_create_manager' (d8db5977-e22e-4d7a-87ca-73b521118341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdcd015-86ab-4c71-8234-6da5455ca138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdcd015-86ab-4c71-8234-6da5455ca138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1144268263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95b0fdb-ea19-4adf-9ce1-29d00b945fe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e8d960f6e94e128125fb267c2ac8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:15:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1dbd52f0-45ee-4104-a45c-4fca14e9e18d,status='creating',terminated_at=None,updated_at=2026-07-05T03:15:30Z,use_quota=True,user_id='753d8a82448140818d9cf73a2f43a17e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47d706f-8073-4ec4-abe1-e89a8f8f7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e47d706f-8073-4ec4-abe1-e89a8f8f7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1865a77-5791-4860-a310-17d0c227023c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:30 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1865a77-5791-4860-a310-17d0c227023c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c95b0fdb-ea19-4adf-9ce1-29d00b945fe2', 'volume_name': 'volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2', 'volume_size': 2, 'source_volid': '1dbd52f0-45ee-4104-a45c-4fca14e9e18d', 'source_volstatus': 'available'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c616bbaf-075f-4185-8029-9504a96393ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c616bbaf-075f-4185-8029-9504a96393ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d4af0a-094c-48a2-843e-ba82e2ef1c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:30 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Volume c95b0fdb-ea19-4adf-9ce1-29d00b945fe2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2', 'volume_size': 2, 'source_volid': '1dbd52f0-45ee-4104-a45c-4fca14e9e18d', 'source_volstatus': 'available'} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-13465f0d-223c-4b9f-9014-41286abdfce6 req-bddc1d5f-26bf-4958-96fa-a47cc87d74c4 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd" returned: 0 in 1.198s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-13465f0d-223c-4b9f-9014-41286abdfce6 req-bddc1d5f-26bf-4958-96fa-a47cc87d74c4 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.262s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:30 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Cloning volume 1dbd52f0-45ee-4104-a45c-4fca14e9e18d to volume c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-13465f0d-223c-4b9f-9014-41286abdfce6 req-bddc1d5f-26bf-4958-96fa-a47cc87d74c4 tempest-AttachVolumeNegativeTest-1383062054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8bcac20-6cf7-46d1-aee3-9d06f15f6e24', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Creating offline snapshot e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 of volume 1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964da86-67e8-4990-ac6e-29fd65e2e5c6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-13465f0d-223c-4b9f-9014-41286abdfce6 req-bddc1d5f-26bf-4958-96fa-a47cc87d74c4 tempest-AttachVolumeNegativeTest-1383062054 None] attachment_update completed successfully. Jul 05 05:15:30 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d Jul 05 05:15:30 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:30 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:15:30 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:31 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" returned: 0 in 0.906s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:31 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 1G Jul 05 05:15:31 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:31 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.958s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:15:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:15:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 8 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:15:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:15:32 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 1G" returned: 0 in 1.126s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:32 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 Jul 05 05:15:32 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:33 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" returned: 0 in 0.820s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:33 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 is being set with open permissions: ugo+rw Jul 05 05:15:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:33 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 Jul 05 05:15:33 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:33 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" returned: 0 in 0.681s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:33 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.info Jul 05 05:15:33 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:34 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.info" returned: 0 in 0.693s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:34 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.info is being set with open permissions: ugo+rw Jul 05 05:15:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:34 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.info Jul 05 05:15:34 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:35 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.info" returned: 0 in 0.677s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Acquiring lock "cinder-quobyte-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] snapshot: e7fb30dd-9c40-4cab-b296-57c0af6c2ba9, volume: c95b0fdb-ea19-4adf-9ce1-29d00b945fe2, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b185f5-2e06-4799-bc11-eec5f54c18aa]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:35 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 Jul 05 05:15:35 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:36 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" returned: 0 in 0.863s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[36467bfb-09d3-4222-8be9-b7fdbfe65b9a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:36 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d Jul 05 05:15:36 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:36 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" returned: 0 in 0.843s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:15:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:36 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 Jul 05 05:15:36 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-39d0a326-6303-445e-810f-0fa4531aed99 req-13d55357-adc7-4ce9-8ea6-82b240876355 tempest-AttachVolumeNegativeTest-1383062054 None] Terminate volume connection completed successfully. Jul 05 05:15:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-39d0a326-6303-445e-810f-0fa4531aed99 req-13d55357-adc7-4ce9-8ea6-82b240876355 tempest-AttachVolumeNegativeTest-1383062054 None] Deleting attachment a8bcac20-6cf7-46d1-aee3-9d06f15f6e24. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:15:43 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" returned: 0 in 7.050s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aee3581-e820-4528-940b-abf98399e4be]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:44 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d Jul 05 05:15:44 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:45 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" returned: 0 in 1.188s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:15:45 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Converted 1024.00 MB image at 145.22 MB/s Jul 05 05:15:45 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 is being set with open permissions: ugo+rw Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:45 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 Jul 05 05:15:45 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:45 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" returned: 0 in 0.629s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" released by "_copy_volume_from_snapshot" :: held 10.690s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=83,cinder:SELECT=62,cinder:DELETE=6,cinder:INSERT=13 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Acquiring lock "cinder-quobyte-e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Deleting offline snapshot e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 of volume 1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] snapshot_file for this snap is: volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c809b7-3c35-4753-8857-31324c4cd1c9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:46 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 Jul 05 05:15:46 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:46 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" returned: 0 in 0.744s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:15:46 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a36b5b-a3d6-43f0-87a7-4c4df6a9981b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:46 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d Jul 05 05:15:46 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:47 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:15:47 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" returned: 0 in 0.763s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:47 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 Jul 05 05:15:47 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:48 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" returned: 0 in 0.751s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:48 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9 Jul 05 05:15:48 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:48 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d.e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" returned: 0 in 0.685s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-e7fb30dd-9c40-4cab-b296-57c0af6c2ba9" released by "_delete_snapshot" :: held 3.036s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.895s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82d4af0a-094c-48a2-843e-ba82e2ef1c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2', 'volume_size': 2, 'source_volid': '1dbd52f0-45ee-4104-a45c-4fca14e9e18d', 'source_volstatus': 'available'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4001582-3e92-4055-842c-0a9e0e875e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:15:49 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Volume volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 (c95b0fdb-ea19-4adf-9ce1-29d00b945fe2): created successfully Jul 05 05:15:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4001582-3e92-4055-842c-0a9e0e875e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:15:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Flow 'volume_create_manager' (d8db5977-e22e-4d7a-87ca-73b521118341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:15:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-99f8cdec-769b-41c3-8baa-560fe47b1ace tempest-VolumesCloneTest-1470368385 None] Created volume successfully. Jul 05 05:15:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Acquiring lock "cinder-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Lock "cinder-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Acquiring lock "cinder-quobyte-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54b58d-c488-43cd-83fa-e355b84e5884]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:50 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 Jul 05 05:15:50 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:50 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" returned: 0 in 0.766s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:50 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2 Jul 05 05:15:50 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:51 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" returned: 0 in 0.654s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2" released by "delete_volume" :: held 1.470s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Created reservations ['1601cf60-5257-4f95-a809-c1060725020b', '20cc0b24-9a04-4a7f-be8c-139242651e11', 'd361e742-f5cb-4e39-8e04-b1fb24dba9d7', '1318b9c8-1c74-48e0-a7a5-18918719d261'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:51 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:15:51 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Acquiring lock "cinder-1dbd52f0-45ee-4104-a45c-4fca14e9e18d-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Lock "cinder-1dbd52f0-45ee-4104-a45c-4fca14e9e18d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:52 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.677s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:15:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Deleted volume successfully. Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6babbf43-aef0-4b1a-a2a7-181ac9780e1f tempest-VolumesCloneTest-1470368385 None] Lock "cinder-c95b0fdb-ea19-4adf-9ce1-29d00b945fe2-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Acquiring lock "cinder-quobyte-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2317d9-3b77-4761-a4a8-0d5aa24cc0d0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:15:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:52 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d Jul 05 05:15:52 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:53 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" returned: 0 in 0.826s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:53 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d Jul 05 05:15:53 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:53 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" returned: 0 in 0.661s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Lock "cinder-quobyte-1dbd52f0-45ee-4104-a45c-4fca14e9e18d" released by "delete_volume" :: held 1.573s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Created reservations ['a9bf9289-93ee-4693-9874-dff2ee6f31cc', '7edff91b-edd2-4648-88bf-9202d5f9f93d', 'b1111852-272c-47ca-8e20-53a1ccb87b4a', '557ece90-3ac7-43ea-b749-ede75ef5b2ea'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:15:54 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:15:54 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:15:54 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.680s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:15:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Deleted volume successfully. Jul 05 05:15:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8195e37d-97e7-4565-806f-d686b8da66e7 tempest-VolumesCloneTest-1470368385 None] Lock "cinder-1dbd52f0-45ee-4104-a45c-4fca14e9e18d-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:15:55 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-e81e1ef3-32b9-4d6c-83f2-109ba91ae5d7 req-1c17b1ef-ff5c-4258-865b-0f4a6823ac0b tempest-AttachVolumeTestJSON-2104421629 None] Terminate volume connection completed successfully. Jul 05 05:15:55 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-e81e1ef3-32b9-4d6c-83f2-109ba91ae5d7 req-1c17b1ef-ff5c-4258-865b-0f4a6823ac0b tempest-AttachVolumeTestJSON-2104421629 None] Deleting attachment 0251025c-034d-465f-8d83-a5eaf7e5b029. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:16:04 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=22,cinder:SELECT=10,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:16:05 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:16:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Acquiring lock "cinder-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "cinder-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Acquiring lock "cinder-quobyte-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "cinder-quobyte-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:19 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af251b-f86c-4a98-aa10-049bcc0b019c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:19 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 Jul 05 05:16:19 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:20 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1" returned: 0 in 0.981s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:20 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1 Jul 05 05:16:20 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:21 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1" returned: 0 in 0.731s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "cinder-quobyte-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1" released by "delete_volume" :: held 1.784s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Created reservations ['ced1d3fc-d8f4-4a54-901e-2e95cd59a306', '529b7b9e-7432-4d8b-a326-e30701cd911f', '17220b4d-2a9a-4c57-b229-2dc478cebe75', 'c7221cbb-70f4-4261-8c54-9bf4a02d1997'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:21 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:16:21 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:22 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.902s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:22 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:16:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Deleted volume successfully. Jul 05 05:16:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c1142783-d8e3-4e58-91d4-5682b70b73e8 tempest-AttachVolumeShelveTestJSON-783305089 None] Lock "cinder-da9c9ba0-d6d1-41c3-9b4c-b56b173392d1-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Flow 'volume_create_manager' (caa92f9a-9dce-4ddb-9d8e-4bc6a11ba3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9709fc-4017-4ec9-85b4-f2414dbde7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9709fc-4017-4ec9-85b4-f2414dbde7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-385534519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6a9ab1-833e-4d3d-8efa-de70f6a106da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9eaa9d72de248fab142f3502eb748a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:29Z,use_quota=True,user_id='08e02411f33840e6b399edaea94ff619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0802419-b8a4-498f-9885-f44e05071fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0802419-b8a4-498f-9885-f44e05071fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b8992-10e8-4c8f-b83e-e1bc916f9236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b8992-10e8-4c8f-b83e-e1bc916f9236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6a9ab1-833e-4d3d-8efa-de70f6a106da', 'volume_name': 'volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8a37bc-94ba-4658-8fac-28aee012b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8a37bc-94ba-4658-8fac-28aee012b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513fb5ae-f8f8-4313-942c-b6f37b9a0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:28 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Volume 0e6a9ab1-833e-4d3d-8efa-de70f6a106da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da', 'volume_size': 1} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-385534519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6a9ab1-833e-4d3d-8efa-de70f6a106da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9eaa9d72de248fab142f3502eb748a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:29Z,use_quota=True,user_id='08e02411f33840e6b399edaea94ff619',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Creating volume 0e6a9ab1-833e-4d3d-8efa-de70f6a106da {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:16:28 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:16:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:28 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da 1073741824 Jul 05 05:16:28 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Flow 'volume_create_manager' (28b89fcc-cd09-42fb-b45c-f9402ec593d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa04552-59fb-479e-93c0-ee1f77831773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa04552-59fb-479e-93c0-ee1f77831773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-945136993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946435f6-e2da-4848-ab70-046e41be01d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2988d3c4854d688c475b6e0e1e4c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:30Z,use_quota=True,user_id='85b89de949254c0097483ea5ce05f4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca90e8a2-62ad-4503-8197-631be130dfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca90e8a2-62ad-4503-8197-631be130dfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25e2258-e8bd-4352-906c-02724161ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:29 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:30 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:16:30 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:30 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da 1073741824" returned: 0 in 1.944s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:30 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da Jul 05 05:16:30 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25e2258-e8bd-4352-906c-02724161ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '946435f6-e2da-4848-ab70-046e41be01d5', 'volume_name': 'volume-946435f6-e2da-4848-ab70-046e41be01d5', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f7f4ed-054e-457a-b981-3cae7d3e5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f7f4ed-054e-457a-b981-3cae7d3e5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aea809-4de8-463e-ad7c-d3475ae51c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:31 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Volume 946435f6-e2da-4848-ab70-046e41be01d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-946435f6-e2da-4848-ab70-046e41be01d5', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 05:16:31 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Trying to clone 946435f6-e2da-4848-ab70-046e41be01d5 from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:16:31 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:16:31 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Image download 20.69 MB at 20.69 MB/s Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa804c-eb38-4a6d-a127-5cd8a2930b0c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:32 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD Jul 05 05:16:32 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:32 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.787s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:16:32 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da" returned: 0 in 1.915s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] <== create_volume: return (4007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.015s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513fb5ae-f8f8-4313-942c-b6f37b9a0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a26578-2a12-4297-be6c-be4c08c44df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:32 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Volume volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da (0e6a9ab1-833e-4d3d-8efa-de70f6a106da): created successfully Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a26578-2a12-4297-be6c-be4c08c44df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Flow 'volume_create_manager' (caa92f9a-9dce-4ddb-9d8e-4bc6a11ba3c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1ebfede2-9c5b-4c75-ad4c-ec16ae672c5c tempest-AttachVolumeNegativeTest-1383062054 None] Created volume successfully. Jul 05 05:16:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD" returned: 0 in 1.339s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:33 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:33 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e is fetched for user 85b89de949254c0097483ea5ce05f4fc. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:16:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f8930-7f87-4bb5-928a-f9c5864827e1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:33 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD Jul 05 05:16:33 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:34 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD" returned: 0 in 1.021s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-945136993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946435f6-e2da-4848-ab70-046e41be01d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2988d3c4854d688c475b6e0e1e4c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:30Z,use_quota=True,user_id='85b89de949254c0097483ea5ce05f4fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Creating volume 946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:16:34 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:16:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:34 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 1073741824 Jul 05 05:16:34 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:35 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 1073741824" returned: 0 in 1.027s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:35 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:16:35 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Flow 'volume_create_manager' (9b6b39f9-a351-4b93-bce4-8db9828b9ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c9b113-4552-42e6-915d-b488122887f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c9b113-4552-42e6-915d-b488122887f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-184398117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45ca818-77b9-434c-8c22-7d2c9c65c095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db972c5ab41f465bbeb662b26ee9fe65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:36Z,use_quota=True,user_id='11aabb72a4ec4cc597438a94f2dbfbe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa25093-49c2-427f-9835-88abbf134eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa25093-49c2-427f-9835-88abbf134eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294acffa-01a9-413e-a0ee-6a053b97ec70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294acffa-01a9-413e-a0ee-6a053b97ec70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45ca818-77b9-434c-8c22-7d2c9c65c095', 'volume_name': 'volume-a45ca818-77b9-434c-8c22-7d2c9c65c095', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df73eb83-b3b1-4722-9da3-2742aaf81307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df73eb83-b3b1-4722-9da3-2742aaf81307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f089f5-168b-4815-b216-604d9b7b10f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Volume a45ca818-77b9-434c-8c22-7d2c9c65c095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45ca818-77b9-434c-8c22-7d2c9c65c095', 'volume_size': 1} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:36 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 0 in 1.048s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-184398117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45ca818-77b9-434c-8c22-7d2c9c65c095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db972c5ab41f465bbeb662b26ee9fe65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:36Z,use_quota=True,user_id='11aabb72a4ec4cc597438a94f2dbfbe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Creating volume a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:16:36 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:36 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 1073741824 Jul 05 05:16:36 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Attempting download of 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume 946435f6-e2da-4848-ab70-046e41be01d5. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c1642e-fffd-498e-adef-7198845332ff]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_6_bgriad {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:37 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_6_bgriad Jul 05 05:16:37 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-6b153fcc-1efd-410d-b9ec-2e920c7f8dda req-fcb507a2-32dd-4e3f-ac66-489b3b0f6dfd tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:38 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 1073741824" returned: 0 in 1.224s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:38 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_6_bgriad" returned: 0 in 1.096s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_6_bgriad {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:38 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 Jul 05 05:16:38 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:38 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_6_bgriad Jul 05 05:16:38 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:38 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095" returned: 0 in 0.789s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-6b153fcc-1efd-410d-b9ec-2e920c7f8dda req-fcb507a2-32dd-4e3f-ac66-489b3b0f6dfd tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.704s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e2a89-b84f-4a3f-8b78-036f21030bd9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-6b153fcc-1efd-410d-b9ec-2e920c7f8dda req-fcb507a2-32dd-4e3f-ac66-489b3b0f6dfd tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:38 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_6_bgriad" returned: 1 in 0.880s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_6_bgriad' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df08a6-bfa7-4918-bf31-77f3074f2867]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f089f5-168b-4815-b216-604d9b7b10f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45ca818-77b9-434c-8c22-7d2c9c65c095', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de39997-d09d-4f22-acbb-63f2d5df6a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Volume volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 (a45ca818-77b9-434c-8c22-7d2c9c65c095): created successfully Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de39997-d09d-4f22-acbb-63f2d5df6a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Flow 'volume_create_manager' (9b6b39f9-a351-4b93-bce4-8db9828b9ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-4ae61b3f-7f4c-45bb-bae4-53aeb5f86297 req-5953fdeb-0ea8-422e-9c4a-025a9264bf02 tempest-VolumesSnapshotsTestJSON-887463088 None] Created volume successfully. Jul 05 05:16:39 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da Jul 05 05:16:39 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:39 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD Jul 05 05:16:39 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:39 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-6b153fcc-1efd-410d-b9ec-2e920c7f8dda req-fcb507a2-32dd-4e3f-ac66-489b3b0f6dfd tempest-AttachVolumeNegativeTest-1383062054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da" returned: 0 in 0.923s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-6b153fcc-1efd-410d-b9ec-2e920c7f8dda req-fcb507a2-32dd-4e3f-ac66-489b3b0f6dfd tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.946s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-6b153fcc-1efd-410d-b9ec-2e920c7f8dda req-fcb507a2-32dd-4e3f-ac66-489b3b0f6dfd tempest-AttachVolumeNegativeTest-1383062054 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acb955a7-a9f9-4937-b95a-f93bce14146e', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:16:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-6b153fcc-1efd-410d-b9ec-2e920c7f8dda req-fcb507a2-32dd-4e3f-ac66-489b3b0f6dfd tempest-AttachVolumeNegativeTest-1383062054 None] attachment_update completed successfully. Jul 05 05:16:40 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD" returned: 0 in 1.126s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e was qcow2, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:40 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:16:40 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Creating offline snapshot 4077171c-7646-4778-b678-93d5e4efe337 of volume a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a4e79-f5b3-4edf-8f0d-0c816c41f810]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:40 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 Jul 05 05:16:40 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:41 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095" returned: 0 in 0.847s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:41 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 1G Jul 05 05:16:41 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:42 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 1G" returned: 0 in 0.990s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:42 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 Jul 05 05:16:42 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:42 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 0 in 2.336s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:42 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_q5anc2ctdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:16:42 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Converted 112.00 MB image at 47.92 MB/s Jul 05 05:16:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:42 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 1G Jul 05 05:16:42 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:42 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337" returned: 0 in 0.782s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:42 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 is being set with open permissions: ugo+rw Jul 05 05:16:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:42 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 Jul 05 05:16:42 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:43 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 1G" returned: 0 in 0.798s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ac5973-f0db-40b2-9e6d-b958c3f1bf82]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:43 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:16:43 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:43 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337" returned: 0 in 0.751s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:43 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.info Jul 05 05:16:43 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:44 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 0 in 0.995s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:44 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:16:44 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:44 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.info" returned: 0 in 0.774s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:44 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.info is being set with open permissions: ugo+rw Jul 05 05:16:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:44 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.info Jul 05 05:16:44 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:45 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 1 in 0.827s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Downloaded image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume 946435f6-e2da-4848-ab70-046e41be01d5 successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e for user 85b89de949254c0097483ea5ce05f4fc is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Marking volume 946435f6-e2da-4848-ab70-046e41be01d5 as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:16:45 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.info" returned: 0 in 0.705s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.993s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Copying metadata from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e to 946435f6-e2da-4848-ab70-046e41be01d5. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Creating volume glance metadata for volume 946435f6-e2da-4848-ab70-046e41be01d5 backed by image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:16:45 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-66b0439b-669c-49a9-be26-3608256a278e req-551cfcd1-4604-4e0b-8cfc-faa802f1809c tempest-VolumesSnapshotsTestJSON-887463088 None] Create snapshot completed successfully Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aea809-4de8-463e-ad7c-d3475ae51c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946435f6-e2da-4848-ab70-046e41be01d5', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1be69f0-9797-431a-8590-c60371ba8b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:45 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Volume volume-946435f6-e2da-4848-ab70-046e41be01d5 (946435f6-e2da-4848-ab70-046e41be01d5): created successfully Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1be69f0-9797-431a-8590-c60371ba8b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Flow 'volume_create_manager' (28b89fcc-cd09-42fb-b45c-f9402ec593d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:45 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-05b4ad8f-3617-4e14-9de9-52eed741ed7d tempest-TestShelveInstance-1392774284 None] Created volume successfully. Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "cinder-4077171c-7646-4778-b678-93d5e4efe337-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-4077171c-7646-4778-b678-93d5e4efe337-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "cinder-quobyte-a45ca818-77b9-434c-8c22-7d2c9c65c095" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-quobyte-a45ca818-77b9-434c-8c22-7d2c9c65c095" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "cinder-quobyte-4077171c-7646-4778-b678-93d5e4efe337" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-quobyte-4077171c-7646-4778-b678-93d5e4efe337" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Deleting offline snapshot 4077171c-7646-4778-b678-93d5e4efe337 of volume a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] snapshot_file for this snap is: volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fcc52d-b3ca-47c0-8025-a4008145bccd]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:46 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 Jul 05 05:16:46 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-595edaba-a50b-462f-8785-226b8f479a12 req-5e7f0f96-9e25-41d1-9b38-e2514ba4710c tempest-AttachVolumeNegativeTest-1383062054 None] Terminate volume connection completed successfully. Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-595edaba-a50b-462f-8785-226b8f479a12 req-5e7f0f96-9e25-41d1-9b38-e2514ba4710c tempest-AttachVolumeNegativeTest-1383062054 None] Deleting attachment acb955a7-a9f9-4937-b95a-f93bce14146e. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:16:46 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337" returned: 0 in 0.817s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a45ca818-77b9-434c-8c22-7d2c9c65c095(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f62cdad-20db-4639-8891-0beff14b18a5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:47 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 Jul 05 05:16:47 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:47 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095" returned: 0 in 0.852s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:47 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 Jul 05 05:16:47 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:48 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337" returned: 0 in 0.826s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:48 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337 Jul 05 05:16:48 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:49 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095.4077171c-7646-4778-b678-93d5e4efe337" returned: 0 in 0.712s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-quobyte-4077171c-7646-4778-b678-93d5e4efe337" released by "_delete_snapshot" :: held 3.331s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-quobyte-a45ca818-77b9-434c-8c22-7d2c9c65c095" released by "delete_snapshot" :: held 3.353s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:49 devstack cinder-volume[86688]: WARNING cinder.quota [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:16:49 devstack cinder-volume[86688]: DEBUG cinder.quota [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Created reservations ['5076b4ae-8b3b-42ac-9b94-c9c9daa6c992', '182f0d9d-d28e-4d55-bb58-90e65b3ff738', '18380e71-7461-4305-bf45-f4ce247bb32a', 'fd2ecca5-f0ab-4549-88d7-7b27794b56e2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:16:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Delete snapshot completed successfully. Jul 05 05:16:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-2ffd749b-8445-4508-abbd-9a3680147432 req-20ac0ff4-16a6-4dd1-92b0-b89a960a4197 tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-4077171c-7646-4778-b678-93d5e4efe337-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "cinder-a45ca818-77b9-434c-8c22-7d2c9c65c095-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-a45ca818-77b9-434c-8c22-7d2c9c65c095-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "cinder-quobyte-a45ca818-77b9-434c-8c22-7d2c9c65c095" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-quobyte-a45ca818-77b9-434c-8c22-7d2c9c65c095" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a92900b-9b92-421b-a58c-6a92b1c91dff]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:50 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 Jul 05 05:16:50 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:51 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095" returned: 0 in 0.869s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:51 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095 Jul 05 05:16:51 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:52 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a45ca818-77b9-434c-8c22-7d2c9c65c095" returned: 0 in 0.795s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-quobyte-a45ca818-77b9-434c-8c22-7d2c9c65c095" released by "delete_volume" :: held 1.741s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG cinder.quota [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Created reservations ['229c875e-3855-413d-b5d2-55178774312a', '77ccb594-2857-4f6f-92ff-23eaa68d8afb', '401fabc9-2732-4973-b8d8-a28f8af545c3', 'b85b6c1f-9ec0-40a0-88aa-6289cc2c00e0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:52 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:16:52 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:53 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.115s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:53 devstack cinder-volume[86688]: DEBUG cinder.manager [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:16:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Deleted volume successfully. Jul 05 05:16:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-ea746dc0-6211-4d37-9ae5-3932c76f7413 req-bbbabdd5-9725-4952-8d40-9086441e754a tempest-VolumesSnapshotsTestJSON-887463088 None] Lock "cinder-a45ca818-77b9-434c-8c22-7d2c9c65c095-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:54 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd8b836-58c1-4ae5-a4df-e326d4d4c39e]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:54 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:16:54 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:55 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 0 in 0.961s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:55 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:16:55 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:55 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 1 in 0.856s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:16:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.919s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-946435f6-e2da-4848-ab70-046e41be01d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c16619a-ae08-4bfe-ad1f-c0df5ed90a38', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:16:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-9e566eae-ce4f-423f-a496-83a5c74d3237 req-b55136cb-d803-464e-838f-b09e0118f540 tempest-TestShelveInstance-1392774284 None] attachment_update completed successfully. Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "cinder-0e6a9ab1-833e-4d3d-8efa-de70f6a106da-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-0e6a9ab1-833e-4d3d-8efa-de70f6a106da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "cinder-quobyte-0e6a9ab1-833e-4d3d-8efa-de70f6a106da" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-quobyte-0e6a9ab1-833e-4d3d-8efa-de70f6a106da" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb51e0-ce36-4822-9f76-bcc20960a8ff]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:57 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da Jul 05 05:16:57 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:16:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Flow 'volume_create_manager' (3ae2203a-1574-4a5b-a929-7ef05be7625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6258cb3e-e5c9-4883-9f57-a82be269092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6258cb3e-e5c9-4883-9f57-a82be269092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1343811357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f69f608-f4a8-42ac-9733-0f3f60174c31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08c36ceb46e54788a62e3cbac228c0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:58Z,use_quota=True,user_id='7929e566001d46b39312aa7a03818736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f98b39c-84c7-4ff0-99dc-e8d1b5f010e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f98b39c-84c7-4ff0-99dc-e8d1b5f010e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cd219c-8097-45dd-bbef-254f436540ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cd219c-8097-45dd-bbef-254f436540ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f69f608-f4a8-42ac-9733-0f3f60174c31', 'volume_name': 'volume-3f69f608-f4a8-42ac-9733-0f3f60174c31', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1280f715-ea6a-47f1-ade7-8a4f7137fb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1280f715-ea6a-47f1-ade7-8a4f7137fb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31319b9-c0e3-4ceb-ab02-846548fc557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Volume 3f69f608-f4a8-42ac-9733-0f3f60174c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f69f608-f4a8-42ac-9733-0f3f60174c31', 'volume_size': 1} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1343811357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f69f608-f4a8-42ac-9733-0f3f60174c31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='08c36ceb46e54788a62e3cbac228c0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:58Z,use_quota=True,user_id='7929e566001d46b39312aa7a03818736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Creating volume 3f69f608-f4a8-42ac-9733-0f3f60174c31 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:16:58 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:58 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 1073741824 Jul 05 05:16:58 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:58 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da" returned: 0 in 1.061s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:58 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da Jul 05 05:16:58 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Flow 'volume_create_manager' (dba8bc1c-67d7-4e9d-8192-10d7500a6f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330e5009-ac15-4596-b17f-bbf0c1f7dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330e5009-ac15-4596-b17f-bbf0c1f7dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1264038351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66da6131-b2bf-422d-b0aa-201be4550b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6016cc19a40c498a4c932dd170497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:59Z,use_quota=True,user_id='e90c56d4e1fb4f83a56696b244323d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffcd4d3-bcb3-458f-9cf1-038672056f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffcd4d3-bcb3-458f-9cf1-038672056f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63114688-4ef4-4542-b6f5-809323a90812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63114688-4ef4-4542-b6f5-809323a90812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66da6131-b2bf-422d-b0aa-201be4550b9d', 'volume_name': 'volume-66da6131-b2bf-422d-b0aa-201be4550b9d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab3bae8-4084-436c-a59a-4c346cd4ff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab3bae8-4084-436c-a59a-4c346cd4ff57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d78617-1fcb-4a28-beed-c4de551dfe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:16:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Volume 66da6131-b2bf-422d-b0aa-201be4550b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66da6131-b2bf-422d-b0aa-201be4550b9d', 'volume_size': 1} Jul 05 05:16:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:59 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 1073741824" returned: 0 in 0.974s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:59 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 Jul 05 05:16:59 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:59 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0e6a9ab1-833e-4d3d-8efa-de70f6a106da" returned: 0 in 0.737s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-quobyte-0e6a9ab1-833e-4d3d-8efa-de70f6a106da" released by "delete_volume" :: held 1.858s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Created reservations ['eaefad9f-93c5-4572-b1a7-4d7e5678572f', '7b187b90-ffba-4e90-b133-6a98e61bcdd9', 'e6d5028f-f3b1-4b39-88c4-100a75c0e349', '1fd49eac-4e02-4e91-8a37-0313f306cfbf'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:59 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:16:59 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "cinder-43d6ce40-465f-43fe-9ae9-3b6e121589bd-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-43d6ce40-465f-43fe-9ae9-3b6e121589bd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "cinder-quobyte-43d6ce40-465f-43fe-9ae9-3b6e121589bd" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-quobyte-43d6ce40-465f-43fe-9ae9-3b6e121589bd" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7fa1c4-3ebf-45f9-8244-af8069c6a73f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:16:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:16:59 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd Jul 05 05:16:59 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:00 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31" returned: 0 in 0.951s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.279s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1264038351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66da6131-b2bf-422d-b0aa-201be4550b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6016cc19a40c498a4c932dd170497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:16:59Z,use_quota=True,user_id='e90c56d4e1fb4f83a56696b244323d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Creating volume 66da6131-b2bf-422d-b0aa-201be4550b9d {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:00 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31319b9-c0e3-4ceb-ab02-846548fc557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f69f608-f4a8-42ac-9733-0f3f60174c31', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:00 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d 1073741824 Jul 05 05:17:00 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7fd238-0abd-472b-893c-0a8de1a3cfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:00 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Volume volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 (3f69f608-f4a8-42ac-9733-0f3f60174c31): created successfully Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7fd238-0abd-472b-893c-0a8de1a3cfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Flow 'volume_create_manager' (3ae2203a-1574-4a5b-a929-7ef05be7625b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-cf1daad2-fe96-46c2-a2aa-73daaa447da3 req-a83b5bd3-2655-4ed7-823b-9b1477e3375d tempest-VolumesGetTestJSON-1412568921 None] Created volume successfully. Jul 05 05:17:00 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.157s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Deleted volume successfully. Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f85cb189-3105-4743-94e0-0c5d09b67a0c tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-0e6a9ab1-833e-4d3d-8efa-de70f6a106da-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Acquiring lock "cinder-3f69f608-f4a8-42ac-9733-0f3f60174c31-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Lock "cinder-3f69f608-f4a8-42ac-9733-0f3f60174c31-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Acquiring lock "cinder-quobyte-3f69f608-f4a8-42ac-9733-0f3f60174c31" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Lock "cinder-quobyte-3f69f608-f4a8-42ac-9733-0f3f60174c31" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2524efc9-0b7e-4f57-983e-7aa55ec184d8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:01 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 Jul 05 05:17:01 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:01 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d 1073741824" returned: 0 in 1.257s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:01 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd" returned: 0 in 1.515s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:01 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd Jul 05 05:17:01 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:01 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d Jul 05 05:17:01 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:02 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31" returned: 0 in 0.981s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:02 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31 Jul 05 05:17:02 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:02 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-43d6ce40-465f-43fe-9ae9-3b6e121589bd" returned: 0 in 1.030s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-quobyte-43d6ce40-465f-43fe-9ae9-3b6e121589bd" released by "delete_volume" :: held 2.677s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:02 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d" returned: 0 in 1.025s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d78617-1fcb-4a28-beed-c4de551dfe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66da6131-b2bf-422d-b0aa-201be4550b9d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c82c23-ac87-42c8-a384-54248318fe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:02 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Volume volume-66da6131-b2bf-422d-b0aa-201be4550b9d (66da6131-b2bf-422d-b0aa-201be4550b9d): created successfully Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c82c23-ac87-42c8-a384-54248318fe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Flow 'volume_create_manager' (dba8bc1c-67d7-4e9d-8192-10d7500a6f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-dc67cc92-3cdf-4d30-8a92-359d52601ec9 tempest-AttachVolumeTestJSON-2104421629 None] Created volume successfully. Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Created reservations ['4464b428-2d45-4264-a18d-16fe55fe226e', '75f18f7e-bec1-4649-8186-cf49c3c3ee5d', '132b3464-65f1-4e07-aa2a-67f581d1bf89', '4cbbf9e8-3a52-4fca-9251-517841a5b8c3'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:02 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:02 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:02 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3f69f608-f4a8-42ac-9733-0f3f60174c31" returned: 0 in 0.875s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Lock "cinder-quobyte-3f69f608-f4a8-42ac-9733-0f3f60174c31" released by "delete_volume" :: held 1.917s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.quota [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Created reservations ['717f908a-bee3-4a91-915a-d0aa4832a58e', 'd419c75f-23d7-4a8a-bef3-71edff6f2436', '1c1c57dd-08a1-43a0-a9a7-1dae13b5dc02', 'b139d822-e03c-421f-8cf8-094915b0a590'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:03 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:03 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "cinder-01b2103f-01c7-4413-a6f8-d905d61c0380-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-01b2103f-01c7-4413-a6f8-d905d61c0380-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "cinder-quobyte-01b2103f-01c7-4413-a6f8-d905d61c0380" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-quobyte-01b2103f-01c7-4413-a6f8-d905d61c0380" acquired by "delete_volume" :: waited 0.040s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:03 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.172s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c22cf7-1766-4af2-a1c1-09cfe50346c9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Deleted volume successfully. Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-133c9161-38d1-4f62-9c77-f6cef0efeed9 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-43d6ce40-465f-43fe-9ae9-3b6e121589bd-delete_volume" released by "delete_volume" :: held 4.249s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:04 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 Jul 05 05:17:04 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:04 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.504s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:04 devstack cinder-volume[86688]: DEBUG cinder.manager [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Deleted volume successfully. Jul 05 05:17:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-27c3d249-361b-4b16-ae57-92504806f5e4 req-f54e510c-2cef-4cbf-b2cd-7ef9570a66c9 tempest-VolumesGetTestJSON-1412568921 None] Lock "cinder-3f69f608-f4a8-42ac-9733-0f3f60174c31-delete_volume" released by "delete_volume" :: held 3.826s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:05 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380" returned: 0 in 1.274s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:05 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380 Jul 05 05:17:05 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:06 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-01b2103f-01c7-4413-a6f8-d905d61c0380" returned: 0 in 1.190s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-quobyte-01b2103f-01c7-4413-a6f8-d905d61c0380" released by "delete_volume" :: held 2.564s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Created reservations ['74cd4abd-eefd-4af9-bfc8-128ecea37766', '45d8d83a-3422-47f4-bcec-27f335c31509', '75efc3c2-8c32-464c-bc87-675d423e1048', '396f6a94-896a-45ed-8457-94f46cecd406'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:06 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:06 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-ecff986a-656c-4bd5-a452-ecf44db4573b req-6541d60c-37e3-4659-98e3-d0ee6532ed55 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-ecff986a-656c-4bd5-a452-ecf44db4573b req-6541d60c-37e3-4659-98e3-d0ee6532ed55 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8876637-8eae-4fdf-a2ba-bc67e582a1ac]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ecff986a-656c-4bd5-a452-ecf44db4573b req-6541d60c-37e3-4659-98e3-d0ee6532ed55 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:07 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d Jul 05 05:17:07 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:08 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:08 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Deleted volume successfully. Jul 05 05:17:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1ab6a26f-ccd3-4f26-85ee-4f4d8bcd9d57 tempest-AttachVolumeNegativeTest-1383062054 None] Lock "cinder-01b2103f-01c7-4413-a6f8-d905d61c0380-delete_volume" released by "delete_volume" :: held 4.909s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:08 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-ecff986a-656c-4bd5-a452-ecf44db4573b req-6541d60c-37e3-4659-98e3-d0ee6532ed55 tempest-AttachVolumeTestJSON-2104421629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d" returned: 0 in 1.858s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-ecff986a-656c-4bd5-a452-ecf44db4573b req-6541d60c-37e3-4659-98e3-d0ee6532ed55 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.884s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-ecff986a-656c-4bd5-a452-ecf44db4573b req-6541d60c-37e3-4659-98e3-d0ee6532ed55 tempest-AttachVolumeTestJSON-2104421629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-66da6131-b2bf-422d-b0aa-201be4550b9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d953ab1-7c9f-4aa3-b056-da6dd9a03874', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:17:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-ecff986a-656c-4bd5-a452-ecf44db4573b req-6541d60c-37e3-4659-98e3-d0ee6532ed55 tempest-AttachVolumeTestJSON-2104421629 None] attachment_update completed successfully. Jul 05 05:17:10 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:17:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Flow 'volume_create_manager' (8109822b-b572-4af3-b43a-00f945ca2ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd730b5-6799-459e-8e33-716df93c9f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd730b5-6799-459e-8e33-716df93c9f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1952175358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ea93b0-0ff3-4f6d-b652-0b920f10ac61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81df2f8cfdfb4850baa458bae90c7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:11Z,use_quota=True,user_id='0e3d1fa253214165ba1276b3c16165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c945cffc-126e-4979-acfc-f5f04e499fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c945cffc-126e-4979-acfc-f5f04e499fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4c5722-79f8-4cf0-a115-f24a9a2c6829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4c5722-79f8-4cf0-a115-f24a9a2c6829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ea93b0-0ff3-4f6d-b652-0b920f10ac61', 'volume_name': 'volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd3dde8-d701-4744-b571-9385aafec82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd3dde8-d701-4744-b571-9385aafec82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09775157-61ea-4ac5-8836-a1d47d7f01f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Volume 47ea93b0-0ff3-4f6d-b652-0b920f10ac61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61', 'volume_size': 1} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1952175358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ea93b0-0ff3-4f6d-b652-0b920f10ac61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81df2f8cfdfb4850baa458bae90c7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:11Z,use_quota=True,user_id='0e3d1fa253214165ba1276b3c16165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Creating volume 47ea93b0-0ff3-4f6d-b652-0b920f10ac61 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:11 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:17:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:11 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 1073741824 Jul 05 05:17:11 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:12 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 1073741824" returned: 0 in 1.202s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:12 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 Jul 05 05:17:12 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:13 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61" returned: 0 in 0.928s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09775157-61ea-4ac5-8836-a1d47d7f01f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a38a6a-5021-4a94-89f6-2cb9949b2147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:13 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Volume volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 (47ea93b0-0ff3-4f6d-b652-0b920f10ac61): created successfully Jul 05 05:17:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a38a6a-5021-4a94-89f6-2cb9949b2147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Flow 'volume_create_manager' (8109822b-b572-4af3-b43a-00f945ca2ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-28f87028-1eb1-4ff5-b35a-f363faef61cc tempest-VolumesTestJSON-1701751481 None] Created volume successfully. Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=87,cinder:SELECT=85,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Flow 'volume_create_manager' (21d95498-1cd2-49ff-a4eb-09855c4ce59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6784e2e-1134-46e3-9ca8-8f5e1e830a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6784e2e-1134-46e3-9ca8-8f5e1e830a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-346747867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9de08-7f84-4495-94a9-94d4410468e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6016cc19a40c498a4c932dd170497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:14Z,use_quota=True,user_id='e90c56d4e1fb4f83a56696b244323d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea35246-7580-43a6-84f2-92b21449f08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea35246-7580-43a6-84f2-92b21449f08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bbaea-e8ee-45cf-8ec1-92189f226fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bbaea-e8ee-45cf-8ec1-92189f226fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f9de08-7f84-4495-94a9-94d4410468e0', 'volume_name': 'volume-b2f9de08-7f84-4495-94a9-94d4410468e0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875b3294-9747-4fc0-9db8-3ac4c09d3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875b3294-9747-4fc0-9db8-3ac4c09d3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4cf8b9-0413-415f-81f9-b9a2d85e1d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:14 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Volume b2f9de08-7f84-4495-94a9-94d4410468e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f9de08-7f84-4495-94a9-94d4410468e0', 'volume_size': 1} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-346747867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f9de08-7f84-4495-94a9-94d4410468e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b6016cc19a40c498a4c932dd170497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:14Z,use_quota=True,user_id='e90c56d4e1fb4f83a56696b244323d9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Creating volume b2f9de08-7f84-4495-94a9-94d4410468e0 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:14 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:14 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 1073741824 Jul 05 05:17:14 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Flow 'volume_create_manager' (7f306800-76dc-437e-8688-0afc76e143e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2da8a79-037a-4203-a5bc-50e9885a256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2da8a79-037a-4203-a5bc-50e9885a256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-140006866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1080b858-6ce2-4cff-8396-3ce526215e42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81df2f8cfdfb4850baa458bae90c7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:15Z,use_quota=True,user_id='0e3d1fa253214165ba1276b3c16165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc4d502-d62a-44ab-8d3f-21c5dbb16727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc4d502-d62a-44ab-8d3f-21c5dbb16727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5e8e92-80b7-4e7f-a61e-d6e2a0a20822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5e8e92-80b7-4e7f-a61e-d6e2a0a20822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1080b858-6ce2-4cff-8396-3ce526215e42', 'volume_name': 'volume-1080b858-6ce2-4cff-8396-3ce526215e42', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa0b7d5-c8ad-4f8f-8613-afffdfa0a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa0b7d5-c8ad-4f8f-8613-afffdfa0a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e39a925-1657-4e54-9dfb-594c620bcc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:15 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Volume 1080b858-6ce2-4cff-8396-3ce526215e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1080b858-6ce2-4cff-8396-3ce526215e42', 'volume_size': 1} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:15 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 1073741824" returned: 0 in 0.995s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=71,cinder:INSERT=27,cinder:UPDATE=74,cinder:DELETE=8 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:17:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:15 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 Jul 05 05:17:15 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:16 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0" returned: 0 in 0.730s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-140006866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1080b858-6ce2-4cff-8396-3ce526215e42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81df2f8cfdfb4850baa458bae90c7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:15Z,use_quota=True,user_id='0e3d1fa253214165ba1276b3c16165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Creating volume 1080b858-6ce2-4cff-8396-3ce526215e42 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:16 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4cf8b9-0413-415f-81f9-b9a2d85e1d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f9de08-7f84-4495-94a9-94d4410468e0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:16 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 1073741824 Jul 05 05:17:16 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e67cd11-904f-4c0b-918a-8cd779c19a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:16 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Volume volume-b2f9de08-7f84-4495-94a9-94d4410468e0 (b2f9de08-7f84-4495-94a9-94d4410468e0): created successfully Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e67cd11-904f-4c0b-918a-8cd779c19a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Flow 'volume_create_manager' (21d95498-1cd2-49ff-a4eb-09855c4ce59c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:16 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a2e2d5ce-6a1a-46ca-8631-bc44b2e7a1b0 tempest-AttachVolumeTestJSON-2104421629 None] Created volume successfully. Jul 05 05:17:17 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 1073741824" returned: 0 in 1.039s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:17 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 Jul 05 05:17:17 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:18 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42" returned: 0 in 0.906s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e39a925-1657-4e54-9dfb-594c620bcc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1080b858-6ce2-4cff-8396-3ce526215e42', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca98461-11aa-4fe1-993e-ac0e45a2b3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:18 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Volume volume-1080b858-6ce2-4cff-8396-3ce526215e42 (1080b858-6ce2-4cff-8396-3ce526215e42): created successfully Jul 05 05:17:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca98461-11aa-4fe1-993e-ac0e45a2b3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Flow 'volume_create_manager' (7f306800-76dc-437e-8688-0afc76e143e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7495f52e-2b66-41b7-9b10-daba0b7e5d8c tempest-VolumesTestJSON-1701751481 None] Created volume successfully. Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Flow 'volume_create_manager' (65c240bf-11e5-4073-ab4a-8cc181b89e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37211ddd-36d1-4220-8a74-cd256a51ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37211ddd-36d1-4220-8a74-cd256a51ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1361813982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1367e3b6-ceba-4146-b7cb-01772bd24601,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81df2f8cfdfb4850baa458bae90c7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:20Z,use_quota=True,user_id='0e3d1fa253214165ba1276b3c16165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53955cca-7d65-40f4-87f9-e017171f0490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53955cca-7d65-40f4-87f9-e017171f0490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67480ae5-4e07-41ce-b89a-ad5a47d19b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67480ae5-4e07-41ce-b89a-ad5a47d19b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1367e3b6-ceba-4146-b7cb-01772bd24601', 'volume_name': 'volume-1367e3b6-ceba-4146-b7cb-01772bd24601', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138c435a-64d5-4a4d-b0ed-683e29826fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138c435a-64d5-4a4d-b0ed-683e29826fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0182a4c-a835-455b-abea-98977a2bd7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Volume 1367e3b6-ceba-4146-b7cb-01772bd24601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1367e3b6-ceba-4146-b7cb-01772bd24601', 'volume_size': 1} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1361813982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1367e3b6-ceba-4146-b7cb-01772bd24601,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81df2f8cfdfb4850baa458bae90c7e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:20Z,use_quota=True,user_id='0e3d1fa253214165ba1276b3c16165af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Creating volume 1367e3b6-ceba-4146-b7cb-01772bd24601 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:20 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:17:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:20 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 1073741824 Jul 05 05:17:20 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:21 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 1073741824" returned: 0 in 1.026s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-c4d2f26f-63c3-4a98-8787-2584c2292d44 req-15bfb050-86cf-40b3-8d1e-4416618dc0bb tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:21 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 Jul 05 05:17:21 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:21 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601" returned: 0 in 0.712s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-c4d2f26f-63c3-4a98-8787-2584c2292d44 req-15bfb050-86cf-40b3-8d1e-4416618dc0bb tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.735s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0c6cbc-3afc-477b-8299-94e4067a3854]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-c4d2f26f-63c3-4a98-8787-2584c2292d44 req-15bfb050-86cf-40b3-8d1e-4416618dc0bb tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0182a4c-a835-455b-abea-98977a2bd7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1367e3b6-ceba-4146-b7cb-01772bd24601', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d493f37-7a6d-4435-b2e1-4cd7e69da127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Volume volume-1367e3b6-ceba-4146-b7cb-01772bd24601 (1367e3b6-ceba-4146-b7cb-01772bd24601): created successfully Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d493f37-7a6d-4435-b2e1-4cd7e69da127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Flow 'volume_create_manager' (65c240bf-11e5-4073-ab4a-8cc181b89e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-25e558b8-2347-4cfc-b0b0-eb8807732330 tempest-VolumesTestJSON-1701751481 None] Created volume successfully. Jul 05 05:17:21 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 Jul 05 05:17:21 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:22 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-c4d2f26f-63c3-4a98-8787-2584c2292d44 req-15bfb050-86cf-40b3-8d1e-4416618dc0bb tempest-AttachVolumeTestJSON-2104421629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-c4d2f26f-63c3-4a98-8787-2584c2292d44 req-15bfb050-86cf-40b3-8d1e-4416618dc0bb tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-c4d2f26f-63c3-4a98-8787-2584c2292d44 req-15bfb050-86cf-40b3-8d1e-4416618dc0bb tempest-AttachVolumeTestJSON-2104421629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-b2f9de08-7f84-4495-94a9-94d4410468e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8c78537-7dfa-44b7-8c0b-0d2ad47304fd', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:17:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-c4d2f26f-63c3-4a98-8787-2584c2292d44 req-15bfb050-86cf-40b3-8d1e-4416618dc0bb tempest-AttachVolumeTestJSON-2104421629 None] attachment_update completed successfully. Jul 05 05:17:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7bc8c4ac-adec-411d-85b3-b88397672eff tempest-BackendsCapabilitiesAdminTestsJSON-1013024796 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548027038574, 'free_capacity_gb': 1775.7548027038574, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86688) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 05:17:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4fa08d35-5652-4f21-bd13-bd15308f7ddd tempest-BackendsCapabilitiesAdminTestsJSON-1013024796 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548027038574, 'free_capacity_gb': 1775.7548027038574, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86688) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 05:17:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "cinder-1367e3b6-ceba-4146-b7cb-01772bd24601-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-1367e3b6-ceba-4146-b7cb-01772bd24601-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "cinder-quobyte-1367e3b6-ceba-4146-b7cb-01772bd24601" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-quobyte-1367e3b6-ceba-4146-b7cb-01772bd24601" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:23 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fdb7ae-2f7d-446e-bbd2-cf860387d3cc]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:24 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 Jul 05 05:17:24 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:24 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601" returned: 0 in 0.888s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:24 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601 Jul 05 05:17:24 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:25 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1367e3b6-ceba-4146-b7cb-01772bd24601" returned: 0 in 0.805s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-quobyte-1367e3b6-ceba-4146-b7cb-01772bd24601" released by "delete_volume" :: held 1.748s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Created reservations ['1912d919-04e8-42f9-8c7f-731f6ea72d00', '66c674e3-e7bf-4135-8174-c3d7045c2fbc', '29765984-465d-4f4d-86a9-637e4923a7ae', '7b574ac3-8447-4bb7-a5bb-1912865ab23e'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:25 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:25 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Acquiring lock "cinder-1080b858-6ce2-4cff-8396-3ce526215e42-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Lock "cinder-1080b858-6ce2-4cff-8396-3ce526215e42-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Acquiring lock "cinder-quobyte-1080b858-6ce2-4cff-8396-3ce526215e42" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Lock "cinder-quobyte-1080b858-6ce2-4cff-8396-3ce526215e42" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c01ffff-1960-4277-acee-9421a85c8b35]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:26 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 Jul 05 05:17:26 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:26 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.873s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Deleted volume successfully. Jul 05 05:17:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d85f1989-1d95-4deb-a28f-f37d298ad473 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-1367e3b6-ceba-4146-b7cb-01772bd24601-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:27 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42" returned: 0 in 1.243s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:27 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42 Jul 05 05:17:27 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:28 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1080b858-6ce2-4cff-8396-3ce526215e42" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Lock "cinder-quobyte-1080b858-6ce2-4cff-8396-3ce526215e42" released by "delete_volume" :: held 2.078s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Created reservations ['6acce09b-39a7-474d-a2c9-0e2ea01c56c9', '11670888-63b8-4826-bf14-96a02e40ed76', 'a3b90b62-05ba-40ac-9cec-013f48c96299', '1a70d8f0-0569-468c-aa30-e0b4e60fdfc1'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:28 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:28 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-72a17293-151e-400a-b1af-a168b40b5f62 req-0ca880d5-bfbe-47c4-b5cf-bcb7698a5baf tempest-AttachVolumeTestJSON-2104421629 None] Terminate volume connection completed successfully. Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-72a17293-151e-400a-b1af-a168b40b5f62 req-0ca880d5-bfbe-47c4-b5cf-bcb7698a5baf tempest-AttachVolumeTestJSON-2104421629 None] Deleting attachment 5d953ab1-7c9f-4aa3-b056-da6dd9a03874. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:17:29 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.842s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Deleted volume successfully. Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51b99f39-9fdb-4ae5-8e38-9ee8693e910f tempest-VolumesTestJSON-1701751481 None] Lock "cinder-1080b858-6ce2-4cff-8396-3ce526215e42-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "cinder-47ea93b0-0ff3-4f6d-b652-0b920f10ac61-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-47ea93b0-0ff3-4f6d-b652-0b920f10ac61-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "cinder-quobyte-47ea93b0-0ff3-4f6d-b652-0b920f10ac61" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-quobyte-47ea93b0-0ff3-4f6d-b652-0b920f10ac61" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c1d324-5c42-495e-8337-86d61a0ccf79]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:29 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 Jul 05 05:17:29 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:17:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:17:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:17:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-65435e3c-c5f8-49fe-86a4-f2a06969b685 tempest-GroupSnapshotsTest-1319003789 None] Group tempest-GroupSnapshotsTest-Group-510676933: creating Jul 05 05:17:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-65435e3c-c5f8-49fe-86a4-f2a06969b685 tempest-GroupSnapshotsTest-1319003789 None] Group tempest-GroupSnapshotsTest-Group-510676933: created successfully Jul 05 05:17:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-65435e3c-c5f8-49fe-86a4-f2a06969b685 tempest-GroupSnapshotsTest-1319003789 None] Create group completed successfully. Jul 05 05:17:30 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61" returned: 0 in 1.063s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:30 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61 Jul 05 05:17:30 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:31 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-47ea93b0-0ff3-4f6d-b652-0b920f10ac61" returned: 0 in 0.691s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-quobyte-47ea93b0-0ff3-4f6d-b652-0b920f10ac61" released by "delete_volume" :: held 1.828s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Created reservations ['196855d3-8aea-4136-9b21-5e13c23873bd', '5546c779-b282-4498-b7af-b2643d364f6a', '10d3527f-1a90-42a0-a17e-5199fa148cd6', 'b7c41a6d-aa93-42bd-80bb-b90016fa2f7f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:31 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-fa459235-039b-4f97-bc63-8e010367d8a9 req-6adb8717-d663-4bab-b2dc-10881791d40c tempest-AttachVolumeTestJSON-2104421629 None] Terminate volume connection completed successfully. Jul 05 05:17:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-fa459235-039b-4f97-bc63-8e010367d8a9 req-6adb8717-d663-4bab-b2dc-10881791d40c tempest-AttachVolumeTestJSON-2104421629 None] Deleting attachment a8c78537-7dfa-44b7-8c0b-0d2ad47304fd. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:17:31 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:31 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (00922c12-d8bc-4768-afa7-e5b570e96e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2799633b-97d5-410e-b411-63246ad3ac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2799633b-97d5-410e-b411-63246ad3ac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2012313414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe810365-7170-49de-b9b8-093e70ea642f,host='devstack@QuobyteHD#QuobyteHD',id=b48895fe-a1b8-4d53-8f27-5de344fdbaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:32Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7552a08b-7c8c-40b5-9f69-c8e4ae143362),volume_type_id=7552a08b-7c8c-40b5-9f69-c8e4ae143362)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d3df2e-ad9e-4c36-80d6-1ac636ae7d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d3df2e-ad9e-4c36-80d6-1ac636ae7d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3338063d-8619-47f1-a1de-91ea56f7888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3338063d-8619-47f1-a1de-91ea56f7888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48895fe-a1b8-4d53-8f27-5de344fdbaf7', 'volume_name': 'volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba85668-11f2-4b06-903e-78423f2e7cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba85668-11f2-4b06-903e-78423f2e7cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5818438e-77c3-4490-9063-3a6076a1c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:32 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Volume b48895fe-a1b8-4d53-8f27-5de344fdbaf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7', 'volume_size': 1} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe810365-7170-49de-b9b8-093e70ea642f,created_at=2026-07-05T03:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2012313414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe810365-7170-49de-b9b8-093e70ea642f,host='devstack@QuobyteHD#QuobyteHD',id=b48895fe-a1b8-4d53-8f27-5de344fdbaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:32Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7552a08b-7c8c-40b5-9f69-c8e4ae143362),volume_type_id=7552a08b-7c8c-40b5-9f69-c8e4ae143362)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Creating volume b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:32 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:32 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 1073741824 Jul 05 05:17:32 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:32 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.910s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Deleted volume successfully. Jul 05 05:17:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48dc9742-0eb4-47e7-bd73-5ee732551d18 tempest-VolumesTestJSON-1701751481 None] Lock "cinder-47ea93b0-0ff3-4f6d-b652-0b920f10ac61-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:33 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 1073741824" returned: 0 in 1.019s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:33 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 Jul 05 05:17:33 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:34 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5818438e-77c3-4490-9063-3a6076a1c440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c04593-e439-4f6d-ad11-8aa0a83b2ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:34 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Volume volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 (b48895fe-a1b8-4d53-8f27-5de344fdbaf7): created successfully Jul 05 05:17:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c04593-e439-4f6d-ad11-8aa0a83b2ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (00922c12-d8bc-4768-afa7-e5b570e96e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:34 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9ce40a6c-ba3c-419e-9c12-8a365234894a tempest-GroupSnapshotsTest-1319003789 None] Created volume successfully. Jul 05 05:17:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] GroupSnapshot a59a92cd-82db-4e36-87ad-c2db32e9c50d: creating. Jul 05 05:17:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Group snapshot a59a92cd-82db-4e36-87ad-c2db32e9c50d: creating. {{(pid=86688) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 05:17:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Creating offline snapshot ec1e5de8-58c8-4790-80ba-9674379220a2 of volume b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:17:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c54252-bc1b-46e3-825a-08edcf32c64c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:35 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 Jul 05 05:17:35 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:36 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" returned: 0 in 0.957s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:36 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 1G Jul 05 05:17:36 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-8c5ab4e4-8f8c-48a0-af64-c0798a94869c req-46851db0-dc1b-4cd1-a84a-2f7243a1b027 tempest-TestShelveInstance-1392774284 None] Terminate volume connection completed successfully. Jul 05 05:17:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-8c5ab4e4-8f8c-48a0-af64-c0798a94869c req-46851db0-dc1b-4cd1-a84a-2f7243a1b027 tempest-TestShelveInstance-1392774284 None] Deleting attachment 4c16619a-ae08-4bfe-ad1f-c0df5ed90a38. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:17:37 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 1G" returned: 0 in 1.358s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:37 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 Jul 05 05:17:37 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7a786ced-18a8-447e-bcfc-e95c513f7106 tempest-GroupsV320Test-485460099 None] Group tempest-GroupsV320Test-Group-879865712: creating Jul 05 05:17:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7a786ced-18a8-447e-bcfc-e95c513f7106 tempest-GroupsV320Test-485460099 None] Group tempest-GroupsV320Test-Group-879865712: created successfully Jul 05 05:17:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7a786ced-18a8-447e-bcfc-e95c513f7106 tempest-GroupsV320Test-485460099 None] Create group completed successfully. Jul 05 05:17:38 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2" returned: 0 in 0.982s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:38 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:17:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:38 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 Jul 05 05:17:38 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:39 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2" returned: 0 in 0.741s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:39 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.info Jul 05 05:17:39 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Created reservations ['5615b35c-6935-42cf-87d3-a9dd41c14bce'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:39 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:39 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:40 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.info" returned: 0 in 0.929s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:40 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:17:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:40 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.info Jul 05 05:17:40 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:40 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.765s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:40 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:40 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5cc6afa8-3d6b-418a-8c3f-0532c5ef3726 tempest-GroupsV320Test-485460099 None] Delete group completed successfully. Jul 05 05:17:40 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.info" returned: 0 in 0.746s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.835s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-558c55e7-f7bf-4874-a0ee-838d3e7d400e tempest-GroupSnapshotsTest-1319003789 None] group_snapshot a59a92cd-82db-4e36-87ad-c2db32e9c50d: created successfully Jul 05 05:17:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:42 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4334b5b-6fc4-4060-b86a-eb8066ae326d]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:42 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:17:42 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "cinder-b2f9de08-7f84-4495-94a9-94d4410468e0-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-b2f9de08-7f84-4495-94a9-94d4410468e0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "cinder-quobyte-b2f9de08-7f84-4495-94a9-94d4410468e0" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-quobyte-b2f9de08-7f84-4495-94a9-94d4410468e0" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[848665ba-6b4d-4ca2-a212-53b7bdef01e9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:43 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 0 in 1.029s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:43 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 Jul 05 05:17:43 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:44 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:17:44 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:44 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0" returned: 0 in 0.982s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:44 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0 Jul 05 05:17:44 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:44 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 1 in 0.895s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.984s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.246s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-ec1e5de8-58c8-4790-80ba-9674379220a2-f9656036-debd-43fb-9ff2-fda8231048a5" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-ec1e5de8-58c8-4790-80ba-9674379220a2-f9656036-debd-43fb-9ff2-fda8231048a5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Creating volume f9656036-debd-43fb-9ff2-fda8231048a5 from snapshot ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-f9656036-debd-43fb-9ff2-fda8231048a5" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-f9656036-debd-43fb-9ff2-fda8231048a5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] snapshot: ec1e5de8-58c8-4790-80ba-9674379220a2, volume: f9656036-debd-43fb-9ff2-fda8231048a5, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-946435f6-e2da-4848-ab70-046e41be01d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b44a9fe1-8fae-481f-8c72-534642376733', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50366a6-7fc7-445f-a840-187b90669d46]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-a9e2295a-75bf-4c4d-9793-b23866f9c4ba req-91929acc-5d3e-4732-ab29-3c7ba851e1e1 tempest-TestShelveInstance-1392774284 None] attachment_update completed successfully. Jul 05 05:17:45 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 Jul 05 05:17:45 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:45 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b2f9de08-7f84-4495-94a9-94d4410468e0" returned: 0 in 0.798s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-quobyte-b2f9de08-7f84-4495-94a9-94d4410468e0" released by "delete_volume" :: held 1.849s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Created reservations ['e6474118-c08d-4d96-a438-14d433cc2c2e', '283f2017-4b9e-4e61-ab41-2c0e111b9d93', '364d29df-2bff-4430-acd7-cae7c9ab3bc1', 'd5922bea-a04e-4a34-a4b4-11201012dd09'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:45 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:45 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:45 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2" returned: 0 in 0.971s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a280efe4-5170-4db6-8719-24adc6cdf778]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:45 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 Jul 05 05:17:45 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "cinder-66da6131-b2bf-422d-b0aa-201be4550b9d-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-66da6131-b2bf-422d-b0aa-201be4550b9d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "cinder-quobyte-66da6131-b2bf-422d-b0aa-201be4550b9d" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-quobyte-66da6131-b2bf-422d-b0aa-201be4550b9d" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09a24c0-26cb-4c7c-9219-f016208ed2f3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:46 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d Jul 05 05:17:46 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:46 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.876s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Deleted volume successfully. Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a71e92f-c22a-458e-bdfa-48b9e0ca1a2d tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-b2f9de08-7f84-4495-94a9-94d4410468e0-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:46 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" returned: 0 in 0.967s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:17:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:46 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 Jul 05 05:17:46 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Flow 'volume_create_manager' (db102fc2-30cf-4eaa-9036-d665430633c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:47 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f91414-a9b8-4b3e-a5a7-1f7001c5b8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d" returned: 0 in 1.041s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f91414-a9b8-4b3e-a5a7-1f7001c5b8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1842241125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109ee959-3079-4066-8b34-6374c17ea09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83bf25424d5d4b18967964fb3c9ad10f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:47Z,use_quota=True,user_id='fdfceea4e92d4e94a8d1d1779c4cdebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:47 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d Jul 05 05:17:47 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c25d158-ef78-4ac2-bb37-3ec6d64bcd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c25d158-ef78-4ac2-bb37-3ec6d64bcd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb906fe-d06c-4581-9fb9-6a91058cf35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb906fe-d06c-4581-9fb9-6a91058cf35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109ee959-3079-4066-8b34-6374c17ea09e', 'volume_name': 'volume-109ee959-3079-4066-8b34-6374c17ea09e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0705550-3249-4a2b-a6e7-9677bfe323c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0705550-3249-4a2b-a6e7-9677bfe323c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3206d3-4d37-4c0b-931e-d047e073b919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:47 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Volume 109ee959-3079-4066-8b34-6374c17ea09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109ee959-3079-4066-8b34-6374c17ea09e', 'volume_size': 1} Jul 05 05:17:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:48 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-66da6131-b2bf-422d-b0aa-201be4550b9d" returned: 0 in 1.150s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-quobyte-66da6131-b2bf-422d-b0aa-201be4550b9d" released by "delete_volume" :: held 2.246s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Created reservations ['5bc811f5-8d6f-48a6-893e-eb5b3c44166a', '5c9836e5-8c6d-4983-ae46-89969d9dedba', '8cd6d6a9-f057-4171-8a60-c2e783ab4af1', 'd7742a4e-6e79-48fa-9b1c-494aea7f11d5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:48 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:48 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "cinder-89487fa4-3b12-4573-9b40-4a11b0a74ed3-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-89487fa4-3b12-4573-9b40-4a11b0a74ed3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "cinder-quobyte-89487fa4-3b12-4573-9b40-4a11b0a74ed3" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-quobyte-89487fa4-3b12-4573-9b40-4a11b0a74ed3" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eded45-5ce1-485b-b58c-f267d4facf8c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:50 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.561s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:50 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Deleted volume successfully. Jul 05 05:17:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8b3a679d-e723-4417-925a-61eea7e23c3f tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-66da6131-b2bf-422d-b0aa-201be4550b9d-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:50 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 Jul 05 05:17:50 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:51 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3" returned: 0 in 1.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:51 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3 Jul 05 05:17:51 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:53 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5" returned: 0 in 6.321s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:53 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9851664-90c0-4964-89a6-ded7e2bc301a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-89487fa4-3b12-4573-9b40-4a11b0a74ed3" returned: 0 in 1.378s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-quobyte-89487fa4-3b12-4573-9b40-4a11b0a74ed3" released by "delete_volume" :: held 3.121s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Created reservations ['d6fb63db-5be0-4478-b582-217968954ff0', '0081d162-b47e-43f9-a17b-2c6c21ea76bb', '95f2712c-c43f-4227-a28a-5d3c821d7fbb', 'ab5a37cc-dc0a-415e-bc34-7aa9d00ff78d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:53 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 Jul 05 05:17:53 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:53 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:53 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:54 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.836s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:17:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Deleted volume successfully. Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-59a49bab-5fec-4ee9-9a4f-fcb2a6138c74 tempest-AttachVolumeTestJSON-2104421629 None] Lock "cinder-89487fa4-3b12-4573-9b40-4a11b0a74ed3-delete_volume" released by "delete_volume" :: held 4.234s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:54 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" returned: 0 in 1.034s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:17:54 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Converted 1024.00 MB image at 161.96 MB/s Jul 05 05:17:54 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:54 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 Jul 05 05:17:54 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:54 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-f9656036-debd-43fb-9ff2-fda8231048a5" released by "_copy_volume_from_snapshot" :: held 10.138s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-ec1e5de8-58c8-4790-80ba-9674379220a2-f9656036-debd-43fb-9ff2-fda8231048a5" released by "_create_volume_from_snapshot" :: held 10.177s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.201s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.656s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1842241125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109ee959-3079-4066-8b34-6374c17ea09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83bf25424d5d4b18967964fb3c9ad10f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:17:47Z,use_quota=True,user_id='fdfceea4e92d4e94a8d1d1779c4cdebb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Creating volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:17:54 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:17:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:54 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e 1073741824 Jul 05 05:17:54 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:55 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-01a937ae-39ff-4f21-a7bb-0121f3ec9db3 tempest-GroupSnapshotsTest-1319003789 None] Create group from source-snapshot-a59a92cd-82db-4e36-87ad-c2db32e9c50d completed successfully. Jul 05 05:17:56 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e 1073741824" returned: 0 in 1.104s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-f9656036-debd-43fb-9ff2-fda8231048a5" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:17:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-f9656036-debd-43fb-9ff2-fda8231048a5" acquired by "delete_volume" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:17:56 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e Jul 05 05:17:56 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fa433e-0833-4d67-a152-7662744e82a9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:56 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 Jul 05 05:17:56 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:57 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e" returned: 0 in 0.937s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c3206d3-4d37-4c0b-931e-d047e073b919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109ee959-3079-4066-8b34-6374c17ea09e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3994344-5941-4e11-9a55-2738b87a2d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:17:57 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Volume volume-109ee959-3079-4066-8b34-6374c17ea09e (109ee959-3079-4066-8b34-6374c17ea09e): created successfully Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3994344-5941-4e11-9a55-2738b87a2d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Flow 'volume_create_manager' (db102fc2-30cf-4eaa-9036-d665430633c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:17:57 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-aac7fcfb-2ad2-4504-a8db-e8a2f8aecc50 tempest-SnapshotsActionsTest-2140852641 None] Created volume successfully. Jul 05 05:17:57 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5" returned: 0 in 1.243s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:57 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5 Jul 05 05:17:57 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Creating offline snapshot 8c5b0b41-bc2a-422a-90fe-74fb4dcda642 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0991959a-84d3-406a-bb45-8007c58d78e8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:17:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:57 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e Jul 05 05:17:57 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:58 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f9656036-debd-43fb-9ff2-fda8231048a5" returned: 0 in 0.897s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-f9656036-debd-43fb-9ff2-fda8231048a5" released by "delete_volume" :: held 2.202s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['b70c06bc-3bb4-49b0-8a0f-29cc68dbecef'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:58 devstack cinder-volume[86688]: WARNING cinder.quota [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-119691896 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-119691896, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:17:58 devstack cinder-volume[86688]: WARNING cinder.quota [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-119691896 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-119691896, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['6832a13a-a89f-445b-8aff-b0227293874b', '162a40af-7ff6-4478-b564-ef57632eb45a', 'f985fc1e-c1c5-4d50-8c5a-e13fb292511c', '60a2a69b-9840-47b7-98e3-217ba23ede84'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:17:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:58 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:17:58 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:59 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 05 05:17:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e" returned: 0 in 1.314s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:17:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:17:59 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 1G Jul 05 05:17:59 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:17:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot a59a92cd-82db-4e36-87ad-c2db32e9c50d: deleting Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot a59a92cd-82db-4e36-87ad-c2db32e9c50d: deleting {{(pid=86688) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 05:18:00 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.248s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:18:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1f9f6e88-7991-41b3-9f19-73875bd3ecd7 tempest-GroupSnapshotsTest-1319003789 None] Delete group completed successfully. Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-ec1e5de8-58c8-4790-80ba-9674379220a2" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-ec1e5de8-58c8-4790-80ba-9674379220a2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Deleting offline snapshot ec1e5de8-58c8-4790-80ba-9674379220a2 of volume b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] snapshot_file for this snap is: volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[115c7eeb-5177-41cd-bedb-4b145576de30]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:00 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 Jul 05 05:18:00 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:00 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 1G" returned: 0 in 1.580s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:00 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:00 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:01 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2" returned: 0 in 1.480s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57925de-542a-41c7-9c47-519a36d23379]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:01 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 Jul 05 05:18:01 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:01 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 1.248s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:01 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 is being set with open permissions: ugo+rw Jul 05 05:18:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:02 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:02 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:02 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.925s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:02 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" returned: 0 in 1.223s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:02 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.info Jul 05 05:18:02 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:03 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 Jul 05 05:18:03 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:03 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.info" returned: 0 in 0.930s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:03 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.info is being set with open permissions: ugo+rw Jul 05 05:18:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:03 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.info Jul 05 05:18:03 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:04 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2" returned: 0 in 1.090s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:04 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2 Jul 05 05:18:04 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:04 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.info" returned: 0 in 0.894s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.024s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-70591871-dabb-4a14-8af9-ccffbcf5ce7a tempest-SnapshotsActionsTest-2140852641 None] Create snapshot completed successfully Jul 05 05:18:04 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7.ec1e5de8-58c8-4790-80ba-9674379220a2" returned: 0 in 0.828s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-ec1e5de8-58c8-4790-80ba-9674379220a2" released by "_delete_snapshot" :: held 4.786s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" released by "delete_snapshot" :: held 4.828s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:05 devstack cinder-volume[86688]: WARNING cinder.quota [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-119691896 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-119691896, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:18:05 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['ed533ed6-6db8-4f1d-8476-c32549f7f0ea', '8daff15b-77fb-475e-81df-32fd322148db', 'fb13f928-f29a-47a8-abbc-09d6e68e3b65', 'b7cb5ad9-7c35-4e1c-b898-05390c4a1ff8'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:05 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0e8d7d13-dc64-43ad-9cb0-37ada9738828 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot a59a92cd-82db-4e36-87ad-c2db32e9c50d: deleted successfully Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Creating offline snapshot fb8081ba-bb87-4bb6-ad00-39aae2d9a219 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c0d670-ce66-4ed1-8647-3f959179c4e3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:06 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:06 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e610f-0030-44f6-81f5-2b7219b204cf]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:06 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 Jul 05 05:18:06 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:07 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 1.023s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:07 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 1G Jul 05 05:18:07 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:07 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" returned: 0 in 0.966s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:07 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7 Jul 05 05:18:07 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:08 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 1G" returned: 0 in 1.128s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:08 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 Jul 05 05:18:08 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:08 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" returned: 0 in 1.130s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-b48895fe-a1b8-4d53-8f27-5de344fdbaf7" released by "delete_volume" :: held 2.197s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['c16445a7-3f8c-430c-9daa-91a7dd4c2f75'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:08 devstack cinder-volume[86688]: WARNING cinder.db.api [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-119691896'] Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['d7dcaa25-8b46-416b-ad8e-1fe51772a5be', '77601af8-ed06-4e47-9a70-426720615ea4', '95e582e1-8172-4c5f-ad5a-3900c0eefb32', '5960e0f1-ee3d-4f46-9203-83ed351a5943'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:08 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:18:08 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:09 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219" returned: 0 in 1.247s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:09 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 is being set with open permissions: ugo+rw Jul 05 05:18:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:09 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 Jul 05 05:18:09 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-48378114-60ec-4e7b-a6aa-36c65cfc9d63 tempest-GroupSnapshotsTest-1319003789 None] Group tempest-GroupSnapshotsTest-Group-1142675096: creating Jul 05 05:18:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-48378114-60ec-4e7b-a6aa-36c65cfc9d63 tempest-GroupSnapshotsTest-1319003789 None] Group tempest-GroupSnapshotsTest-Group-1142675096: created successfully Jul 05 05:18:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-48378114-60ec-4e7b-a6aa-36c65cfc9d63 tempest-GroupSnapshotsTest-1319003789 None] Create group completed successfully. Jul 05 05:18:09 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.072s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:09 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:18:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-65b0d186-5930-4e50-a1fa-c148aeed7bfe tempest-GroupSnapshotsTest-1319003789 None] Delete group completed successfully. Jul 05 05:18:10 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219" returned: 0 in 0.792s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.372s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-39c393eb-3931-4509-b23e-0b3fb61ee609 tempest-SnapshotsActionsTest-2140852641 None] Create snapshot completed successfully Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (a34e0a8f-0ace-4933-a114-6e22107c0360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bf601c-f798-44be-bfae-aa66f0ab83fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bf601c-f798-44be-bfae-aa66f0ab83fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323500484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=445863b2-d9dd-4638-bcb8-c01120819cc7,host='devstack@QuobyteHD#QuobyteHD',id=3645d4ae-e3e8-4e86-aaf7-fd6d319a8134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:11Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0f3d6dd-6bb0-42d0-abac-766492f2d543),volume_type_id=c0f3d6dd-6bb0-42d0-abac-766492f2d543)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff00963-ad21-4b08-9e31-f4f4af52d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff00963-ad21-4b08-9e31-f4f4af52d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66d7a52-bf12-46c7-ada3-00a93839bde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66d7a52-bf12-46c7-ada3-00a93839bde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3645d4ae-e3e8-4e86-aaf7-fd6d319a8134', 'volume_name': 'volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1b5246-1d5a-4e8b-a587-3030545e575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1b5246-1d5a-4e8b-a587-3030545e575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23a128f-32b6-4ae2-8976-77d0c3fba50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Volume 3645d4ae-e3e8-4e86-aaf7-fd6d319a8134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134', 'volume_size': 1} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=445863b2-d9dd-4638-bcb8-c01120819cc7,created_at=2026-07-05T03:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323500484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=445863b2-d9dd-4638-bcb8-c01120819cc7,host='devstack@QuobyteHD#QuobyteHD',id=3645d4ae-e3e8-4e86-aaf7-fd6d319a8134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:11Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0f3d6dd-6bb0-42d0-abac-766492f2d543),volume_type_id=c0f3d6dd-6bb0-42d0-abac-766492f2d543)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Creating volume 3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:18:11 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:11 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 1073741824 Jul 05 05:18:11 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-fb8081ba-bb87-4bb6-ad00-39aae2d9a219-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-fb8081ba-bb87-4bb6-ad00-39aae2d9a219-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-fb8081ba-bb87-4bb6-ad00-39aae2d9a219" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-fb8081ba-bb87-4bb6-ad00-39aae2d9a219" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Deleting offline snapshot fb8081ba-bb87-4bb6-ad00-39aae2d9a219 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] snapshot_file for this snap is: volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d881d4-139a-42f9-9a55-d2eb8d18698f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:11 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 Jul 05 05:18:11 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:12 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 1073741824" returned: 0 in 1.089s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:12 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 Jul 05 05:18:12 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:12 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219" returned: 0 in 0.984s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a59807-89d5-4d63-a895-00c47158a1df]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:12 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:13 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:13 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" returned: 0 in 0.830s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23a128f-32b6-4ae2-8976-77d0c3fba50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cc0f7b-4feb-4963-a933-9ca1cf958732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:13 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Volume volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 (3645d4ae-e3e8-4e86-aaf7-fd6d319a8134): created successfully Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cc0f7b-4feb-4963-a933-9ca1cf958732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (a34e0a8f-0ace-4933-a114-6e22107c0360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9b6167b5-b642-40fa-a6ab-83e243ba8e49 tempest-GroupSnapshotsTest-1319003789 None] Created volume successfully. Jul 05 05:18:13 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.961s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:13 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 Jul 05 05:18:13 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=98,cinder:UPDATE=117,cinder:INSERT=24,cinder:DELETE=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (b7854807-bf12-414a-a19e-511aff7b1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef6d521-0732-4ae1-9104-2295e6d680ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef6d521-0732-4ae1-9104-2295e6d680ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-952353440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=445863b2-d9dd-4638-bcb8-c01120819cc7,host='devstack@QuobyteHD#QuobyteHD',id=6b0c7393-aed1-4c66-bbe9-aa14fca36890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:15Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0f3d6dd-6bb0-42d0-abac-766492f2d543),volume_type_id=c0f3d6dd-6bb0-42d0-abac-766492f2d543)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79549eb-c253-401f-97ac-707080d4c8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79549eb-c253-401f-97ac-707080d4c8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1326f9f4-8ce7-4e22-89c1-830d46f9416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1326f9f4-8ce7-4e22-89c1-830d46f9416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0c7393-aed1-4c66-bbe9-aa14fca36890', 'volume_name': 'volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105ea4f8-a369-4eec-80f5-30b0289d412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105ea4f8-a369-4eec-80f5-30b0289d412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bba4b0d-2f8a-4c31-8e87-d21916394814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:14 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Volume 6b0c7393-aed1-4c66-bbe9-aa14fca36890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890', 'volume_size': 1} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=445863b2-d9dd-4638-bcb8-c01120819cc7,created_at=2026-07-05T03:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-952353440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=445863b2-d9dd-4638-bcb8-c01120819cc7,host='devstack@QuobyteHD#QuobyteHD',id=6b0c7393-aed1-4c66-bbe9-aa14fca36890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:15Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0f3d6dd-6bb0-42d0-abac-766492f2d543),volume_type_id=c0f3d6dd-6bb0-42d0-abac-766492f2d543)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Creating volume 6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:18:14 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:18:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:15 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 1073741824 Jul 05 05:18:15 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:15 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219" returned: 0 in 1.238s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:15 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219 Jul 05 05:18:15 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:15 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.fb8081ba-bb87-4bb6-ad00-39aae2d9a219" returned: 0 in 0.805s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-fb8081ba-bb87-4bb6-ad00-39aae2d9a219" released by "_delete_snapshot" :: held 4.141s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" released by "delete_snapshot" :: held 4.180s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:15 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=97,cinder:DELETE=7,cinder:SELECT=113,cinder:INSERT=23 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Created reservations ['2ab7ea5e-bf7e-4c2c-ab3a-6f5aeafa4eb1', 'b5e60db0-0a71-4b3e-8c06-595036a82de9', '51ca76fd-c67e-402e-bfc0-5f05ab8545d5', '7612201f-2f2d-4632-a2ad-c9e1dadafc12'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:16 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 1073741824" returned: 0 in 1.101s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:16 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Delete snapshot completed successfully. Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a35de776-cf8c-4b44-914f-89dc16b3135a tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-fb8081ba-bb87-4bb6-ad00-39aae2d9a219-delete_snapshot" released by "delete_snapshot" :: held 4.431s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:16 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 Jul 05 05:18:16 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:16 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890" returned: 0 in 0.661s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bba4b0d-2f8a-4c31-8e87-d21916394814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6d923b-b2b2-4766-ab10-5eb78420cb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:16 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Volume volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 (6b0c7393-aed1-4c66-bbe9-aa14fca36890): created successfully Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6d923b-b2b2-4766-ab10-5eb78420cb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (b7854807-bf12-414a-a19e-511aff7b1b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:16 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0229db72-9e83-4eb5-84f5-2097a1608919 tempest-GroupSnapshotsTest-1319003789 None] Created volume successfully. Jul 05 05:18:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Creating offline snapshot f9608625-257a-4e4d-8921-c545cc08cc10 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:18:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1ff4eb-17d7-4844-ba3f-de689cd34636]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ea2e1868-0caa-4e8d-bd73-3ae82ae4ceca tempest-GroupSnapshotsTest-1319003789 None] Update group completed successfully. Jul 05 05:18:17 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:17 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:18 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.812s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:18 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 1G Jul 05 05:18:18 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1780822e-25bb-4aa4-931a-0bca03a281d6 tempest-GroupSnapshotsTest-1319003789 None] Update group completed successfully. Jul 05 05:18:19 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 1G" returned: 0 in 0.928s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:19 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 Jul 05 05:18:19 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a76114e7-09b7-4e11-b82f-7926e41bc7cf tempest-GroupSnapshotsTest-1319003789 None] Update group completed successfully. Jul 05 05:18:19 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10" returned: 0 in 0.762s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:19 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 is being set with open permissions: ugo+rw Jul 05 05:18:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:19 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 Jul 05 05:18:19 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:20 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10" returned: 0 in 0.765s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.362s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:20 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9928887f-d3ee-43ab-9f7b-cfa4eb4d4544 tempest-SnapshotsActionsTest-2140852641 None] Create snapshot completed successfully Jul 05 05:18:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1cf7f9ab-ac5b-44b1-aa08-14e999f591ec tempest-GroupSnapshotsTest-1319003789 None] Update group completed successfully. Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-f9608625-257a-4e4d-8921-c545cc08cc10-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-f9608625-257a-4e4d-8921-c545cc08cc10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-f9608625-257a-4e4d-8921-c545cc08cc10" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-f9608625-257a-4e4d-8921-c545cc08cc10" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Deleting offline snapshot f9608625-257a-4e4d-8921-c545cc08cc10 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] snapshot_file for this snap is: volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e8f56-9776-4f2c-bfd7-7165cf4d5ea4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:21 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 Jul 05 05:18:21 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] GroupSnapshot 791db770-feae-487a-8536-fcc11fe0b689: creating. Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Group snapshot 791db770-feae-487a-8536-fcc11fe0b689: creating. {{(pid=86688) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:22 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10" returned: 0 in 0.931s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Creating offline snapshot 049eddd8-be81-4a26-87a8-d122bd39daab of volume 6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd396018-8c77-4a57-9e99-72ac0fce1967]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bffc69-60c2-4db4-a611-e1da303de325]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:22 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 Jul 05 05:18:22 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:22 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:22 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:23 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890" returned: 0 in 0.868s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:23 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.897s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:23 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab 1G Jul 05 05:18:23 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:23 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 Jul 05 05:18:23 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:24 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10" returned: 0 in 0.864s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:24 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab 1G" returned: 0 in 0.918s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:24 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10 Jul 05 05:18:24 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:24 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab Jul 05 05:18:24 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:25 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.f9608625-257a-4e4d-8921-c545cc08cc10" returned: 0 in 0.943s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-f9608625-257a-4e4d-8921-c545cc08cc10" released by "_delete_snapshot" :: held 3.798s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" released by "delete_snapshot" :: held 3.832s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:25 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab" returned: 0 in 1.048s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:25 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:18:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:25 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab Jul 05 05:18:25 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Created reservations ['aa4048e6-05a0-47ca-aee2-7980828b176a', 'bea08540-c178-4dfc-a301-f94ddd181b50', '0b2982bd-07f8-4b34-9313-3d4410ac149f', '1261b122-dce9-4aee-97f5-10cb1b2e8830'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:25 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:25 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Delete snapshot completed successfully. Jul 05 05:18:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f7e6d8f0-19be-4dc1-91ec-929dc5dfed99 tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-f9608625-257a-4e4d-8921-c545cc08cc10-delete_snapshot" released by "delete_snapshot" :: held 4.067s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:26 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab" returned: 0 in 0.856s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:26 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.info Jul 05 05:18:26 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Flow 'volume_create_manager' (f0b69e22-5f37-4ff9-92e0-5d56e32ff98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405d28c0-62a1-44d9-8da0-1d331802f150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405d28c0-62a1-44d9-8da0-1d331802f150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545702428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b967c8f1-ba0d-45e2-aa9c-f568aaed9af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a0cb37a92a484ebf60c4ba22662349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:27Z,use_quota=True,user_id='24b72b3265ad4fd3af83bd9b14b9e438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e724ca7c-ab36-42ab-bae1-61968ab20c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e724ca7c-ab36-42ab-bae1-61968ab20c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee51a4e-eaee-4631-9772-fcf03364d444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee51a4e-eaee-4631-9772-fcf03364d444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b967c8f1-ba0d-45e2-aa9c-f568aaed9af6', 'volume_name': 'volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51406ac4-5b70-4d30-9be2-96dbb9c66f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51406ac4-5b70-4d30-9be2-96dbb9c66f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6accf807-a049-4d59-abb8-55d8a3c3f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:27 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Volume b967c8f1-ba0d-45e2-aa9c-f568aaed9af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6', 'volume_size': 1} Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:27 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.info" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:27 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:18:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:27 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.info Jul 05 05:18:27 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:28 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.info" returned: 0 in 0.876s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.480s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Creating offline snapshot 4fe2046b-9778-48b7-93d8-6a1d9b2fb609 of volume 3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:18:28 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[643bf98a-73a7-455b-83ef-9053d0629413]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:28 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 Jul 05 05:18:28 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:29 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" returned: 0 in 0.828s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:29 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 1G Jul 05 05:18:29 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-65248749-ab55-40bb-9b6c-7ba632558214 tempest-TestShelveInstance-1392774284 None] Terminate volume connection completed successfully. Jul 05 05:18:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-65248749-ab55-40bb-9b6c-7ba632558214 tempest-TestShelveInstance-1392774284 None] Deleting attachment b44a9fe1-8fae-481f-8c72-534642376733. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:18:29 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 1G" returned: 0 in 0.785s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:29 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 Jul 05 05:18:29 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Acquiring lock "cinder-946435f6-e2da-4848-ab70-046e41be01d5-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Lock "cinder-946435f6-e2da-4848-ab70-046e41be01d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Acquiring lock "cinder-quobyte-946435f6-e2da-4848-ab70-046e41be01d5" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Lock "cinder-quobyte-946435f6-e2da-4848-ab70-046e41be01d5" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[57695771-cc8f-449d-9109-6e6316230153]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:30 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609" returned: 0 in 0.704s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:30 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:18:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:30 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:18:30 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:30 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 Jul 05 05:18:30 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:30 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:18:30 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:31 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.735s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:18:31 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609" returned: 0 in 0.781s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:31 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 0 in 0.872s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:31 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.info Jul 05 05:18:31 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:31 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:18:31 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:32 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.info" returned: 0 in 0.657s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:32 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:32 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.info Jul 05 05:18:32 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:32 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 1 in 0.774s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:32 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5 Jul 05 05:18:32 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:32 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.info" returned: 0 in 0.710s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:32 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.624s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.729s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545702428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b967c8f1-ba0d-45e2-aa9c-f568aaed9af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a0cb37a92a484ebf60c4ba22662349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:27Z,use_quota=True,user_id='24b72b3265ad4fd3af83bd9b14b9e438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Creating volume b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:18:32 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-946435f6-e2da-4848-ab70-046e41be01d5" returned: 0 in 0.704s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:32 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 1073741824 Jul 05 05:18:32 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Lock "cinder-quobyte-946435f6-e2da-4848-ab70-046e41be01d5" released by "delete_volume" :: held 2.424s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:32 devstack cinder-volume[86688]: DEBUG cinder.quota [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Created reservations ['e4f70232-797f-40ae-93f7-67002673240f', 'fbc1fe67-cf11-47db-ab1f-8a11dc5f8813', 'c4c1fa7e-3edc-47e5-b7ae-463e2fb519d2', 'a270999c-c22e-4fbb-a129-f62f1cb85aef'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d5bdffde-401c-421f-94d8-4cbfc4d56efb tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 791db770-feae-487a-8536-fcc11fe0b689: created successfully Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:33 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:18:33 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 791db770-feae-487a-8536-fcc11fe0b689: deleting Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 791db770-feae-487a-8536-fcc11fe0b689: deleting {{(pid=86688) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-6b0c7393-aed1-4c66-bbe9-aa14fca36890" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-6b0c7393-aed1-4c66-bbe9-aa14fca36890" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-049eddd8-be81-4a26-87a8-d122bd39daab" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-049eddd8-be81-4a26-87a8-d122bd39daab" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Deleting offline snapshot 049eddd8-be81-4a26-87a8-d122bd39daab of volume 6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] snapshot_file for this snap is: volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[017ecafc-f4ff-4813-b5b6-77f8d82daa61]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:33 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab Jul 05 05:18:33 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:33 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.901s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG cinder.manager [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:18:34 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Deleted volume successfully. Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [req-42c88570-37b3-4ec7-9e34-47928942ea5a req-68763b9d-0f39-4e2c-b7f4-dcb4334b49a1 tempest-TestShelveInstance-1392774284 None] Lock "cinder-946435f6-e2da-4848-ab70-046e41be01d5-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:34 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 1073741824" returned: 0 in 1.229s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:34 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 Jul 05 05:18:34 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:34 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab" returned: 0 in 0.975s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3bd8a4-2163-4cf0-95e8-90712ff50033]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:34 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:34 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 Jul 05 05:18:34 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6" returned: 0 in 0.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.438s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Creating offline snapshot 8597e637-dbb1-4784-a262-deb262c73b76 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6accf807-a049-4d59-abb8-55d8a3c3f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891c9c12-af10-443e-84fe-c82d3efc2a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a0348-254b-4485-89ff-2a7427f139ef]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Volume volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 (b967c8f1-ba0d-45e2-aa9c-f568aaed9af6): created successfully Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891c9c12-af10-443e-84fe-c82d3efc2a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Flow 'volume_create_manager' (f0b69e22-5f37-4ff9-92e0-5d56e32ff98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8e55a10f-040c-4f4c-bce2-4eab4541a88a tempest-VolumeQuotasAdminTestJSON-862281194 None] Created volume successfully. Jul 05 05:18:35 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:35 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Acquiring lock "cinder-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "cinder-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Acquiring lock "cinder-quobyte-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "cinder-quobyte-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10e731b-8355-49cf-8a4d-72b6f5f430b8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:35 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890" returned: 0 in 0.989s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:35 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab Jul 05 05:18:35 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:35 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 Jul 05 05:18:35 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:35 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.989s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:36 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 1G Jul 05 05:18:36 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:36 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6" returned: 0 in 0.972s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:36 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6 Jul 05 05:18:36 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:36 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab" returned: 0 in 1.026s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:36 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab Jul 05 05:18:36 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:37 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 1G" returned: 0 in 1.236s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:37 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 Jul 05 05:18:37 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:37 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6" returned: 0 in 0.872s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "cinder-quobyte-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6" released by "delete_volume" :: held 1.896s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Created reservations ['9232865e-277e-4ec2-814b-a48fd8f95aec', 'a1385831-d40a-4a36-8ec1-e13eced4077d', '8e8d79ac-b3c5-4763-bc05-66403755b872', 'ef6667df-0226-478a-be42-15b7fe2fcd8b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:37 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890.049eddd8-be81-4a26-87a8-d122bd39daab" returned: 0 in 0.958s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:37 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:18:37 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-049eddd8-be81-4a26-87a8-d122bd39daab" released by "_delete_snapshot" :: held 4.119s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-6b0c7393-aed1-4c66-bbe9-aa14fca36890" released by "delete_snapshot" :: held 4.160s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-4fe2046b-9778-48b7-93d8-6a1d9b2fb609" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-4fe2046b-9778-48b7-93d8-6a1d9b2fb609" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Deleting offline snapshot 4fe2046b-9778-48b7-93d8-6a1d9b2fb609 of volume 3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] snapshot_file for this snap is: volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07790c9-a386-4718-ae65-1bb2477d129a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:38 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 Jul 05 05:18:38 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:38 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76" returned: 0 in 1.009s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:38 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 is being set with open permissions: ugo+rw Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:38 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 Jul 05 05:18:38 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:38 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.948s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:18:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Deleted volume successfully. Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-44bf5991-2020-4389-9c86-09f571942cd6 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "cinder-b967c8f1-ba0d-45e2-aa9c-f568aaed9af6-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Flow 'volume_create_manager' (9e87fb24-6d9e-4a69-8d29-19ff5efc06b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b226b82-ad96-40e0-8e59-d01eb6f9c5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b226b82-ad96-40e0-8e59-d01eb6f9c5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-269489226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc8c5c3-af6f-495a-924b-00b68525b840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a0cb37a92a484ebf60c4ba22662349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:39Z,use_quota=True,user_id='24b72b3265ad4fd3af83bd9b14b9e438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb990ca-495a-4af2-88cc-9679a2cb01a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb990ca-495a-4af2-88cc-9679a2cb01a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43882bff-15a6-43d0-ac51-cfdb87bf096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43882bff-15a6-43d0-ac51-cfdb87bf096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc8c5c3-af6f-495a-924b-00b68525b840', 'volume_name': 'volume-1bc8c5c3-af6f-495a-924b-00b68525b840', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a39c12-e7dd-4c3b-8f9b-47e8cb603c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a39c12-e7dd-4c3b-8f9b-47e8cb603c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6886428-3785-43a3-b20d-abcfc60bf129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Volume 1bc8c5c3-af6f-495a-924b-00b68525b840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc8c5c3-af6f-495a-924b-00b68525b840', 'volume_size': 1} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:38 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609" returned: 0 in 1.000s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e8127f-3f7d-4027-b697-48f54e69cd17]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:39 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 Jul 05 05:18:39 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:39 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76" returned: 0 in 0.976s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.347s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.390s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-269489226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc8c5c3-af6f-495a-924b-00b68525b840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a0cb37a92a484ebf60c4ba22662349',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:39Z,use_quota=True,user_id='24b72b3265ad4fd3af83bd9b14b9e438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Creating volume 1bc8c5c3-af6f-495a-924b-00b68525b840 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:18:39 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:39 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 1073741824 Jul 05 05:18:39 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-defc334c-78b8-4541-95bf-49b8de502454 tempest-SnapshotsActionsTest-2140852641 None] Create snapshot completed successfully Jul 05 05:18:39 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" returned: 0 in 0.859s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:39 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 Jul 05 05:18:39 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-8597e637-dbb1-4784-a262-deb262c73b76-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-8597e637-dbb1-4784-a262-deb262c73b76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-8597e637-dbb1-4784-a262-deb262c73b76" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-8597e637-dbb1-4784-a262-deb262c73b76" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Deleting offline snapshot 8597e637-dbb1-4784-a262-deb262c73b76 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:40 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] snapshot_file for this snap is: volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 1073741824" returned: 0 in 1.160s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae831734-d5e1-48b7-87f3-639f5ab59be7]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:40 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 Jul 05 05:18:40 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:40 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 Jul 05 05:18:40 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:40 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609" returned: 0 in 0.931s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:40 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609 Jul 05 05:18:40 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:41 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840" returned: 0 in 0.860s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6886428-3785-43a3-b20d-abcfc60bf129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc8c5c3-af6f-495a-924b-00b68525b840', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9054196b-eb5b-410d-af74-d3dbb20c0198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Volume volume-1bc8c5c3-af6f-495a-924b-00b68525b840 (1bc8c5c3-af6f-495a-924b-00b68525b840): created successfully Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9054196b-eb5b-410d-af74-d3dbb20c0198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Flow 'volume_create_manager' (9e87fb24-6d9e-4a69-8d29-19ff5efc06b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fd1569cc-124e-472a-a0fe-ab0b2d813875 tempest-VolumeQuotasAdminTestJSON-862281194 None] Created volume successfully. Jul 05 05:18:41 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76" returned: 0 in 1.052s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ba909-1afe-41f0-9df8-c649c80de47b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:41 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134.4fe2046b-9778-48b7-93d8-6a1d9b2fb609" returned: 0 in 0.767s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-4fe2046b-9778-48b7-93d8-6a1d9b2fb609" released by "_delete_snapshot" :: held 3.711s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" released by "delete_snapshot" :: held 3.782s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:41 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:41 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:41 devstack cinder-volume[86688]: WARNING cinder.quota [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1462523181 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1462523181, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:18:41 devstack cinder-volume[86688]: WARNING cinder.quota [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1462523181 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1462523181, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['777ef7b4-179c-42b8-b7ad-4930fc7d7178', '6c882386-47fa-4107-97bc-02579047a279', '0d08329a-9e99-4647-aaa2-156a6054d5e3', '6b22084d-3528-4a18-8b96-1c56b045e289'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:41 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['fd2bace4-dae6-4f5f-86b9-a5188893bb0d', 'ebb77df8-fd36-4bdc-8a08-49eac50aa042', 'e690b91a-5254-42a1-8251-9a383e7271f4', '349acd33-d218-4f1b-b20e-f7102df27fef'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0f62415f-7989-4fcf-a584-8aedbe99fd10 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 791db770-feae-487a-8536-fcc11fe0b689: deleted successfully Jul 05 05:18:42 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 1.049s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:42 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 Jul 05 05:18:42 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9de027a9-5a0c-4638-bd3b-c30cced92c10 tempest-VolumeQuotasAdminTestJSON-1207859065 None] Transfer volume completed successfully. Jul 05 05:18:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[136480a0-4b3b-4814-8eea-97aaeba6e685]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:43 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 Jul 05 05:18:43 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:43 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76" returned: 0 in 0.943s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:43 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76 Jul 05 05:18:43 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Acquiring lock "cinder-1bc8c5c3-af6f-495a-924b-00b68525b840-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Lock "cinder-1bc8c5c3-af6f-495a-924b-00b68525b840-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Acquiring lock "cinder-quobyte-1bc8c5c3-af6f-495a-924b-00b68525b840" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Lock "cinder-quobyte-1bc8c5c3-af6f-495a-924b-00b68525b840" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ff27b8-ef3f-4013-80ed-bb53dadfec4b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:44 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" returned: 0 in 1.068s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:44 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134 Jul 05 05:18:44 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:44 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 Jul 05 05:18:44 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:44 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8597e637-dbb1-4784-a262-deb262c73b76" returned: 0 in 0.846s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-8597e637-dbb1-4784-a262-deb262c73b76" released by "_delete_snapshot" :: held 4.017s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" released by "delete_snapshot" :: held 4.048s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Created reservations ['6c00307f-f945-4b4a-81af-4ce5475cb159', '24a16472-f916-42fc-9fdc-49aec6dd27f2', '7e644497-b8be-4b3e-9fca-d4829ad1a8bf', '93ce8965-790d-4a3a-aae0-2c84bd453710'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Delete snapshot completed successfully. Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78083644-e06b-4636-a923-029dcd706c6b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-8597e637-dbb1-4784-a262-deb262c73b76-delete_snapshot" released by "delete_snapshot" :: held 4.238s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:44 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Creating offline snapshot 9a70dd2f-f93e-4632-a474-cac9d449a54d of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" returned: 0 in 0.969s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af854af-1946-4bef-884c-989edd8b66a9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-3645d4ae-e3e8-4e86-aaf7-fd6d319a8134" released by "delete_volume" :: held 2.153s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-6b0c7393-aed1-4c66-bbe9-aa14fca36890" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:45 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-6b0c7393-aed1-4c66-bbe9-aa14fca36890" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840" returned: 0 in 1.147s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9a30ca-24e6-4249-94d9-a3bfe4a6a79a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:45 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840 Jul 05 05:18:45 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:45 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:45 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:45 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 Jul 05 05:18:45 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:45 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1bc8c5c3-af6f-495a-924b-00b68525b840" returned: 0 in 0.817s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Lock "cinder-quobyte-1bc8c5c3-af6f-495a-924b-00b68525b840" released by "delete_volume" :: held 2.018s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:46 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.965s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:46 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d 1G Jul 05 05:18:46 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:46 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890" returned: 0 in 0.911s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Created reservations ['f2358479-7f7a-4b90-8f95-28a7955586f7', '04c641c7-ed5b-434e-b2de-505fe9c16884', '56d56a5d-9e18-42df-b79e-539ac1e4c992', '5f7172e3-0007-4dec-af59-a30f5aefcf7f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:46 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890 Jul 05 05:18:46 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:46 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:18:46 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:46 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6b0c7393-aed1-4c66-bbe9-aa14fca36890" returned: 0 in 0.798s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-6b0c7393-aed1-4c66-bbe9-aa14fca36890" released by "delete_volume" :: held 1.800s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['17bcaec2-6ec3-4213-ae49-85cc381dbede'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:47 devstack cinder-volume[86688]: WARNING cinder.quota [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1462523181 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1462523181, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:18:47 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d 1G" returned: 0 in 1.090s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['74a15593-eea2-4679-8001-43874fa94e05', 'fba9653f-02d4-4ec1-9dcd-39b4b11137e2', '9fd32289-b59f-494f-a959-ecfacd5abb1a', '57c0c118-7c45-4974-955c-12cdca58b6db'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:47 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d Jul 05 05:18:47 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:47 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.905s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:18:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Deleted volume successfully. Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-beda069e-6cd3-4e6f-b8e0-14210d895e20 tempest-VolumeQuotasAdminTestJSON-1964094883 None] Lock "cinder-1bc8c5c3-af6f-495a-924b-00b68525b840-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['2f7650bf-2ad6-4410-8103-3c4a72ad2fd3', 'c7d33083-30c4-4d2f-bf5e-f2f68bedf1e7', '56e61c05-d07f-44b0-838a-3ae11edaeb15', 'b614dd5b-9d54-44c6-a155-c4230c6fb9a0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:47 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:18:47 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:48 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d" returned: 0 in 1.029s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:48 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d is being set with open permissions: ugo+rw Jul 05 05:18:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:48 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d Jul 05 05:18:48 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:48 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-719890ee-7316-49db-ba1f-a4effb65b48f tempest-GroupSnapshotsTest-1319003789 None] Group tempest-GroupSnapshotsTest-Group-1089918017: creating Jul 05 05:18:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.029s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:48 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:18:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b07c7af9-22c2-4b3f-a35a-5fd082af1cdb tempest-GroupSnapshotsTest-1319003789 None] Delete group completed successfully. Jul 05 05:18:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-719890ee-7316-49db-ba1f-a4effb65b48f tempest-GroupSnapshotsTest-1319003789 None] Group tempest-GroupSnapshotsTest-Group-1089918017: created successfully Jul 05 05:18:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-719890ee-7316-49db-ba1f-a4effb65b48f tempest-GroupSnapshotsTest-1319003789 None] Create group completed successfully. Jul 05 05:18:49 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d" returned: 0 in 0.831s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.079s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0da28b72-9acc-4459-bc56-1688bbcec448 tempest-SnapshotsActionsTest-2140852641 None] Create snapshot completed successfully Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-9a70dd2f-f93e-4632-a474-cac9d449a54d-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-9a70dd2f-f93e-4632-a474-cac9d449a54d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Acquiring lock "cinder-quobyte-9a70dd2f-f93e-4632-a474-cac9d449a54d" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-9a70dd2f-f93e-4632-a474-cac9d449a54d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Deleting offline snapshot 9a70dd2f-f93e-4632-a474-cac9d449a54d of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] snapshot_file for this snap is: volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dd329c-06ec-4006-a576-edd9b99d2cfe]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:49 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d Jul 05 05:18:49 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (31181bf6-22f0-49f5-a337-23c0f01d49a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a4e590-0fcd-4ddb-8cea-0096348b8bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a4e590-0fcd-4ddb-8cea-0096348b8bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1126199672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8bff3d5-7319-4f74-824b-cbe1f18488ba,host='devstack@QuobyteHD#QuobyteHD',id=a7c787d0-146e-422b-9187-c46948c88eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:50Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b9db1c7-899b-4e36-9ff4-70f652eea13b),volume_type_id=4b9db1c7-899b-4e36-9ff4-70f652eea13b)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe2e6b6-d238-4481-9974-ba350f9fd0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe2e6b6-d238-4481-9974-ba350f9fd0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d92d29-795e-4c35-9175-53f5eb23b974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d92d29-795e-4c35-9175-53f5eb23b974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c787d0-146e-422b-9187-c46948c88eb5', 'volume_name': 'volume-a7c787d0-146e-422b-9187-c46948c88eb5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd8ad2a-9c86-4a96-8c84-cf9280535571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd8ad2a-9c86-4a96-8c84-cf9280535571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d75aad0-d32d-427e-8768-f0e7c37e8ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Volume a7c787d0-146e-422b-9187-c46948c88eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c787d0-146e-422b-9187-c46948c88eb5', 'volume_size': 1} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8bff3d5-7319-4f74-824b-cbe1f18488ba,created_at=2026-07-05T03:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1126199672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8bff3d5-7319-4f74-824b-cbe1f18488ba,host='devstack@QuobyteHD#QuobyteHD',id=a7c787d0-146e-422b-9187-c46948c88eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2121963e75e94c47a8e1eac65b09aa23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:18:50Z,use_quota=True,user_id='dd9912d5842444ec8ae9d331db92ee8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b9db1c7-899b-4e36-9ff4-70f652eea13b),volume_type_id=4b9db1c7-899b-4e36-9ff4-70f652eea13b)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Creating volume a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:18:50 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:50 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 1073741824 Jul 05 05:18:50 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:50 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d" returned: 0 in 1.196s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[694775b0-31a6-44e9-a0ad-ba49131e9d52]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:50 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:50 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.961s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:51 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:51 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d Jul 05 05:18:51 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:51 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 1073741824" returned: 0 in 1.228s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:51 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 Jul 05 05:18:51 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:52 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5" returned: 0 in 0.836s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d75aad0-d32d-427e-8768-f0e7c37e8ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c787d0-146e-422b-9187-c46948c88eb5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f871b4-4ff7-4c42-a994-5105489384be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:18:52 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Volume volume-a7c787d0-146e-422b-9187-c46948c88eb5 (a7c787d0-146e-422b-9187-c46948c88eb5): created successfully Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f871b4-4ff7-4c42-a994-5105489384be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Flow 'volume_create_manager' (31181bf6-22f0-49f5-a337-23c0f01d49a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:18:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-52c2f2c9-0723-471d-9aeb-bfe022f0f96f tempest-GroupSnapshotsTest-1319003789 None] Created volume successfully. Jul 05 05:18:52 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d" returned: 0 in 1.075s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:52 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d Jul 05 05:18:52 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] GroupSnapshot 0f08aee6-61f8-48d5-844b-0729c502b513: creating. Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Group snapshot 0f08aee6-61f8-48d5-844b-0729c502b513: creating. {{(pid=86688) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Creating offline snapshot ca42064f-cd60-4a99-8791-124f7e24ebbc of volume a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d681a82d-4a74-4362-983f-e0e81088a77e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:53 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.9a70dd2f-f93e-4632-a474-cac9d449a54d" returned: 0 in 0.936s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-9a70dd2f-f93e-4632-a474-cac9d449a54d" released by "_delete_snapshot" :: held 4.301s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" released by "delete_snapshot" :: held 4.335s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:53 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 Jul 05 05:18:53 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Created reservations ['5fdbdb17-f974-4890-8ded-ec27aa75d07e', 'c63584bc-ea2e-4c24-a51f-6a327cf2d665', '92f407ca-a0c2-4143-869f-36584b192b09', '000e3a91-12fa-4252-9c5c-a5b07584de2c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Delete snapshot completed successfully. Jul 05 05:18:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-46136c4f-839c-405b-90fc-d00d1060795b tempest-SnapshotsActionsTest-40259728 None] Lock "cinder-9a70dd2f-f93e-4632-a474-cac9d449a54d-delete_snapshot" released by "delete_snapshot" :: held 4.534s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:54 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5" returned: 0 in 0.937s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:54 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc 1G Jul 05 05:18:54 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "cinder-8c5b0b41-bc2a-422a-90fe-74fb4dcda642-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-8c5b0b41-bc2a-422a-90fe-74fb4dcda642-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "cinder-quobyte-8c5b0b41-bc2a-422a-90fe-74fb4dcda642" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-quobyte-8c5b0b41-bc2a-422a-90fe-74fb4dcda642" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Deleting offline snapshot 8c5b0b41-bc2a-422a-90fe-74fb4dcda642 of volume 109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] snapshot_file for this snap is: volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e938451-8eea-46b9-af34-fbe965580d28]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:55 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:55 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:55 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc 1G" returned: 0 in 1.188s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c787d0-146e-422b-9187-c46948c88eb5 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:55 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c787d0-146e-422b-9187-c46948c88eb5 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc Jul 05 05:18:55 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:56 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.946s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-109ee959-3079-4066-8b34-6374c17ea09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:18:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b79a11d-1c90-4e32-9b7a-be7780a3b6b4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:56 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e Jul 05 05:18:56 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:56 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7c787d0-146e-422b-9187-c46948c88eb5 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc" returned: 0 in 0.840s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:56 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:18:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:56 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc Jul 05 05:18:56 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:57 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e" returned: 0 in 0.901s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:57 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc" returned: 0 in 0.758s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:57 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:57 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:57 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.info Jul 05 05:18:57 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:58 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.info" returned: 0 in 0.920s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:58 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:18:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:58 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.info Jul 05 05:18:58 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:58 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 1.074s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:18:58 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642 Jul 05 05:18:58 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:18:59 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.info" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.664s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:18:59 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e.8c5b0b41-bc2a-422a-90fe-74fb4dcda642" returned: 0 in 0.857s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-quobyte-8c5b0b41-bc2a-422a-90fe-74fb4dcda642" released by "_delete_snapshot" :: held 3.913s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" released by "delete_snapshot" :: held 3.958s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-dcda15ce-15c9-49a7-8b78-035a0ea181a0 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 0f08aee6-61f8-48d5-844b-0729c502b513: created successfully Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Created reservations ['19d73d14-fd3b-4615-874c-a028b785ade0', '11023106-f7bd-4062-baf2-e6fe4531c6d4', '733462c7-ef12-4880-a0ff-623de91fa74d', 'bb5b2a46-076c-4d0e-b910-5216f77450c9'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:18:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Delete snapshot completed successfully. Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06517369-e06b-4ba9-b2b6-1b0e38ed67f9 tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-8c5b0b41-bc2a-422a-90fe-74fb4dcda642-delete_snapshot" released by "delete_snapshot" :: held 4.146s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "cinder-109ee959-3079-4066-8b34-6374c17ea09e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-109ee959-3079-4066-8b34-6374c17ea09e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91134a0-c58d-4e30-8fe2-f2a69275addc]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:18:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:00 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e Jul 05 05:19:00 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 0f08aee6-61f8-48d5-844b-0729c502b513: deleting Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 0f08aee6-61f8-48d5-844b-0729c502b513: deleting {{(pid=86688) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-a7c787d0-146e-422b-9187-c46948c88eb5" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-a7c787d0-146e-422b-9187-c46948c88eb5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-ca42064f-cd60-4a99-8791-124f7e24ebbc" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-ca42064f-cd60-4a99-8791-124f7e24ebbc" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Deleting offline snapshot ca42064f-cd60-4a99-8791-124f7e24ebbc of volume a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] snapshot_file for this snap is: volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac00bc5-3d05-4964-8736-c217d030f372]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:00 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc Jul 05 05:19:00 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:01 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e" returned: 0 in 1.198s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:01 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e Jul 05 05:19:01 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:01 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc" returned: 0 in 1.013s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7c787d0-146e-422b-9187-c46948c88eb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[727d4393-43b6-4677-83bd-4820da792a39]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:01 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 Jul 05 05:19:01 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:01 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-109ee959-3079-4066-8b34-6374c17ea09e" returned: 0 in 0.799s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-quobyte-109ee959-3079-4066-8b34-6374c17ea09e" released by "delete_volume" :: held 2.105s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:01 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Created reservations ['12e9ab6b-a431-40f3-94ca-bc20f82afdfc', '3e4b268e-8df8-4eb5-bbcb-876a05fb08f5', 'd1926c38-b95a-4cff-b2ce-6d5be6233542', 'bf49e049-0956-494c-878e-a6bfd84068a1'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:02 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:19:02 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:02 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5" returned: 0 in 0.981s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:02 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc Jul 05 05:19:02 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:02 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.877s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:19:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Deleted volume successfully. Jul 05 05:19:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9a1087f5-336f-4220-afe5-23dd9e4fffcb tempest-SnapshotsActionsTest-2140852641 None] Lock "cinder-109ee959-3079-4066-8b34-6374c17ea09e-delete_volume" released by "delete_volume" :: held 3.296s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:03 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc" returned: 0 in 0.974s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:03 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc Jul 05 05:19:03 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:04 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5.ca42064f-cd60-4a99-8791-124f7e24ebbc" returned: 0 in 0.920s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-ca42064f-cd60-4a99-8791-124f7e24ebbc" released by "_delete_snapshot" :: held 4.052s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-a7c787d0-146e-422b-9187-c46948c88eb5" released by "delete_snapshot" :: held 4.091s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:04 devstack cinder-volume[86688]: WARNING cinder.quota [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-589905162 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-589905162, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:04 devstack cinder-volume[86688]: WARNING cinder.quota [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-589905162 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-589905162, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['09b36706-8b06-40f8-9d19-6e74c01d15a0', '3a4fc086-f961-4d13-b659-1bb49403a4c9', '256cfe40-a43d-47ec-bf30-e8784fa0e9d9', '8333c9e7-11e6-4573-bca8-e906ed1f79f0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-391671b9-51f2-410f-a034-c359df2ead16 tempest-GroupSnapshotsTest-1319003789 None] group_snapshot 0f08aee6-61f8-48d5-844b-0729c502b513: deleted successfully Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Flow 'volume_create_manager' (192db349-1c1d-4da6-b84a-dd1039d5e0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4902032e-6438-4a79-ab08-1e33d66f8b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4902032e-6438-4a79-ab08-1e33d66f8b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-311669690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78598b19-c9e3-41c7-96d1-16bdae9a3e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdec7f296fa42fc92446eb732444479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:05Z,use_quota=True,user_id='c02f034eab3e4674a1802cf9fa770c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27024b8c-3070-4e38-b9f6-fe353c0e8b59),volume_type_id=27024b8c-3070-4e38-b9f6-fe353c0e8b59)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef45d98-3c08-4c3c-9368-648271ee60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef45d98-3c08-4c3c-9368-648271ee60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1935c75e-d699-4f9b-ab30-16a6fadb17f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1935c75e-d699-4f9b-ab30-16a6fadb17f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78598b19-c9e3-41c7-96d1-16bdae9a3e92', 'volume_name': 'volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff544ae-fc6f-4232-a380-9d3bc93aef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff544ae-fc6f-4232-a380-9d3bc93aef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0871c5-52ea-4f31-842f-067de0c8dd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:04 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Volume 78598b19-c9e3-41c7-96d1-16bdae9a3e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92', 'volume_size': 1} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-311669690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78598b19-c9e3-41c7-96d1-16bdae9a3e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdec7f296fa42fc92446eb732444479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:05Z,use_quota=True,user_id='c02f034eab3e4674a1802cf9fa770c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27024b8c-3070-4e38-b9f6-fe353c0e8b59),volume_type_id=27024b8c-3070-4e38-b9f6-fe353c0e8b59)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Creating volume 78598b19-c9e3-41c7-96d1-16bdae9a3e92 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:19:04 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:19:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:04 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 1073741824 Jul 05 05:19:04 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "cinder-quobyte-a7c787d0-146e-422b-9187-c46948c88eb5" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-a7c787d0-146e-422b-9187-c46948c88eb5" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a20d0-06df-499b-a907-27c36fbf956f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:05 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 Jul 05 05:19:05 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:06 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 1073741824" returned: 0 in 1.280s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:06 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 Jul 05 05:19:06 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:06 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5" returned: 0 in 1.102s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:06 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5 Jul 05 05:19:06 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:07 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92" returned: 0 in 0.887s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0871c5-52ea-4f31-842f-067de0c8dd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09fb91c-b343-45a9-be63-a75ab0d35c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:07 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Volume volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 (78598b19-c9e3-41c7-96d1-16bdae9a3e92): created successfully Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09fb91c-b343-45a9-be63-a75ab0d35c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Flow 'volume_create_manager' (192db349-1c1d-4da6-b84a-dd1039d5e0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6578d46a-8bd4-40a2-9f57-4d67d29c23b6 tempest-VolumeTypesAccessTest-1538275422 None] Created volume successfully. Jul 05 05:19:07 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a7c787d0-146e-422b-9187-c46948c88eb5" returned: 0 in 0.830s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Lock "cinder-quobyte-a7c787d0-146e-422b-9187-c46948c88eb5" released by "delete_volume" :: held 2.034s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['54db7f78-b98e-44de-9541-4105963eba1a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:07 devstack cinder-volume[86688]: WARNING cinder.quota [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-589905162 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-589905162, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Created reservations ['b469b3b6-2f32-48ec-b31c-2f1c09a38a91', '3ca1fe8c-ade9-4580-a73b-46b595fa2edf', 'e402ed9c-1669-4734-b8e7-b9be9b1cff61', '83f73e35-8a7e-4b3f-adf5-014c0a1cad09'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:07 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:19:07 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Acquiring lock "cinder-78598b19-c9e3-41c7-96d1-16bdae9a3e92-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Lock "cinder-78598b19-c9e3-41c7-96d1-16bdae9a3e92-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Acquiring lock "cinder-quobyte-78598b19-c9e3-41c7-96d1-16bdae9a3e92" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Lock "cinder-quobyte-78598b19-c9e3-41c7-96d1-16bdae9a3e92" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c3577-ceb7-4d8c-b2df-2dc3ab05d30d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:08 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 Jul 05 05:19:08 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:08 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.199s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:08 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:19:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e9481cbf-2966-4c47-a402-4f3db6a2c8da tempest-GroupSnapshotsTest-1319003789 None] Delete group completed successfully. Jul 05 05:19:09 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92" returned: 0 in 1.252s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:09 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92 Jul 05 05:19:09 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:10 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-78598b19-c9e3-41c7-96d1-16bdae9a3e92" returned: 0 in 1.126s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Lock "cinder-quobyte-78598b19-c9e3-41c7-96d1-16bdae9a3e92" released by "delete_volume" :: held 2.427s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:10 devstack cinder-volume[86688]: WARNING cinder.quota [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-96234920 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-96234920, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:10 devstack cinder-volume[86688]: WARNING cinder.quota [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-96234920 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-96234920, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Created reservations ['03d34022-d975-44e9-adf2-511167e1672b', '1535eb35-e699-4883-9fcd-be72bb64982c', 'e763bb90-57ea-474b-b601-92b816df45af', '0fb1fe89-c59e-459f-ba00-7d901399e707'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:10 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:19:10 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Flow 'volume_create_manager' (c9949f69-fba4-479c-a3d3-ee54502054d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccb1182-bbfd-440e-9f3a-7469794269d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccb1182-bbfd-440e-9f3a-7469794269d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1092490669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c40429-9390-4d02-a36a-032bde9975b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160cdc64562f46e3958fb193aa6f564f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:11Z,use_quota=True,user_id='b79c7484038b41849b68439fa87b6e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4480850-5d3c-443f-bd1b-4e6a57023a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4480850-5d3c-443f-bd1b-4e6a57023a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8bcfc6-8a0a-4cb1-942e-df3268d8054e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8bcfc6-8a0a-4cb1-942e-df3268d8054e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c40429-9390-4d02-a36a-032bde9975b2', 'volume_name': 'volume-e8c40429-9390-4d02-a36a-032bde9975b2', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8be644-5f34-447b-9beb-0a426baea643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8be644-5f34-447b-9beb-0a426baea643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faace41e-57b2-4d2a-800d-4e424449c151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Volume e8c40429-9390-4d02-a36a-032bde9975b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c40429-9390-4d02-a36a-032bde9975b2', 'volume_size': 1} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1092490669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c40429-9390-4d02-a36a-032bde9975b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='160cdc64562f46e3958fb193aa6f564f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:11Z,use_quota=True,user_id='b79c7484038b41849b68439fa87b6e37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Creating volume e8c40429-9390-4d02-a36a-032bde9975b2 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:19:11 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:19:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:11 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 1073741824 Jul 05 05:19:11 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:12 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.211s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:12 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:19:12 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Deleted volume successfully. Jul 05 05:19:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1378972a-02c0-4dde-9437-6301cd09dbb3 tempest-VolumeTypesAccessTest-1538275422 None] Lock "cinder-78598b19-c9e3-41c7-96d1-16bdae9a3e92-delete_volume" released by "delete_volume" :: held 4.001s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:12 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 1073741824" returned: 0 in 1.316s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:12 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 Jul 05 05:19:12 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:13 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2" returned: 0 in 1.057s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] <== create_volume: return (2486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:19:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.490s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faace41e-57b2-4d2a-800d-4e424449c151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c40429-9390-4d02-a36a-032bde9975b2', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5be31b-7b87-48d8-aa41-174ebd04a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:13 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Volume volume-e8c40429-9390-4d02-a36a-032bde9975b2 (e8c40429-9390-4d02-a36a-032bde9975b2): created successfully Jul 05 05:19:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5be31b-7b87-48d8-aa41-174ebd04a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Flow 'volume_create_manager' (c9949f69-fba4-479c-a3d3-ee54502054d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ff1cd430-7906-421a-b6af-cd4332bf0f9a tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Created volume successfully. Jul 05 05:19:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Acquiring lock "cinder-e8c40429-9390-4d02-a36a-032bde9975b2-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "cinder-e8c40429-9390-4d02-a36a-032bde9975b2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:15 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=150,cinder:INSERT=41,cinder:UPDATE=138,cinder:DELETE=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:19:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Acquiring lock "cinder-quobyte-e8c40429-9390-4d02-a36a-032bde9975b2" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "cinder-quobyte-e8c40429-9390-4d02-a36a-032bde9975b2" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e8b51-15fc-468c-b6e6-926620a1f0e6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:15 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 Jul 05 05:19:15 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:16 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2" returned: 0 in 1.191s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:17 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2 Jul 05 05:19:17 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:17 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8c40429-9390-4d02-a36a-032bde9975b2" returned: 0 in 0.922s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "cinder-quobyte-e8c40429-9390-4d02-a36a-032bde9975b2" released by "delete_volume" :: held 2.180s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:17 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=157,cinder:SELECT=117,cinder:DELETE=9,cinder:INSERT=34 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Created reservations ['8e4a9934-3bc7-4341-8b1f-52debdc05610', 'af2e4713-b59e-47d8-b46d-d64fbaaa99f1', 'dfb283e5-13f1-45a1-9e49-cc669a959ab3', '7fa9e668-db3d-48f3-9de4-bf1301e8bbc0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:18 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:19:18 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Flow 'volume_create_manager' (57d369e0-1fb3-4065-a4e4-a7bc6ae6dd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba89dc9-313c-47f4-a3c8-2214392ce33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba89dc9-313c-47f4-a3c8-2214392ce33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1256986051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bb5c89-3fa7-4ac6-a25d-53919912eaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db98ed1cb513415c9389b6f2e967a54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:18Z,use_quota=True,user_id='3cbe4d2b2b9f4328a7dfdae27bd215bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1d28c3-9627-4491-bb3b-bb431be9630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1d28c3-9627-4491-bb3b-bb431be9630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701dc74e-c153-4601-8852-48cab57bc389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701dc74e-c153-4601-8852-48cab57bc389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1bb5c89-3fa7-4ac6-a25d-53919912eaee', 'volume_name': 'volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dee72b5-a349-4bd9-9410-2b54407981f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dee72b5-a349-4bd9-9410-2b54407981f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b44a904-49ed-4755-849f-d63dd22b2647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:18 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Volume b1bb5c89-3fa7-4ac6-a25d-53919912eaee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee', 'volume_size': 1} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1256986051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bb5c89-3fa7-4ac6-a25d-53919912eaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db98ed1cb513415c9389b6f2e967a54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:18Z,use_quota=True,user_id='3cbe4d2b2b9f4328a7dfdae27bd215bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Creating volume b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:19:18 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:19:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:18 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee 1073741824 Jul 05 05:19:18 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6d50f5dc-bd8d-403f-82cd-43de41e3dc44 tempest-GroupSnapshotsV319Test-39411769 None] Group tempest-GroupSnapshotsV319Test-Group-469804236: creating Jul 05 05:19:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6d50f5dc-bd8d-403f-82cd-43de41e3dc44 tempest-GroupSnapshotsV319Test-39411769 None] Group tempest-GroupSnapshotsV319Test-Group-469804236: created successfully Jul 05 05:19:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6d50f5dc-bd8d-403f-82cd-43de41e3dc44 tempest-GroupSnapshotsV319Test-39411769 None] Create group completed successfully. Jul 05 05:19:19 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.995s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:19 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:19:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Deleted volume successfully. Jul 05 05:19:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bd0676c4-25b2-4abe-9594-bbc7e7f0dc2e tempest-VolumeQuotasNegativeTestJSON-1892954381 None] Lock "cinder-e8c40429-9390-4d02-a36a-032bde9975b2-delete_volume" released by "delete_volume" :: held 3.533s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:19 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee 1073741824" returned: 0 in 1.104s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:19 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:19:19 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:20 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 0.962s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b44a904-49ed-4755-849f-d63dd22b2647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6b57b5-bd55-4e1d-9df9-e44eca7cf02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Flow 'volume_create_manager' (494dd2af-e110-4ed2-ba18-1d441e327087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d599eb9-a91a-4f02-b2d7-125b30de39db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d599eb9-a91a-4f02-b2d7-125b30de39db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525081363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=344618fe-7fa1-4ef9-b68a-9b912a16336b,host='devstack@QuobyteHD#QuobyteHD',id=6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06186ee2139426f81a7097115e32380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:21Z,use_quota=True,user_id='42d5c937a2674acf9c8d6f22778b1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(621a2824-2ceb-4a62-acd9-17381827cfed),volume_type_id=621a2824-2ceb-4a62-acd9-17381827cfed)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7556c1ea-4117-4726-aaef-4b10c57838b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7556c1ea-4117-4726-aaef-4b10c57838b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771bfdfb-ff93-4ca1-8054-a7c5c5e29eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771bfdfb-ff93-4ca1-8054-a7c5c5e29eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e', 'volume_name': 'volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0864b4ad-4775-4fdb-bc06-4b9e9c2556a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0864b4ad-4775-4fdb-bc06-4b9e9c2556a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1d3555-698e-4777-b37d-efa78fb66d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Volume 6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e', 'volume_size': 1} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=344618fe-7fa1-4ef9-b68a-9b912a16336b,created_at=2026-07-05T03:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1525081363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=344618fe-7fa1-4ef9-b68a-9b912a16336b,host='devstack@QuobyteHD#QuobyteHD',id=6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b06186ee2139426f81a7097115e32380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:21Z,use_quota=True,user_id='42d5c937a2674acf9c8d6f22778b1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(621a2824-2ceb-4a62-acd9-17381827cfed),volume_type_id=621a2824-2ceb-4a62-acd9-17381827cfed)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Creating volume 6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:19:20 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Volume volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee (b1bb5c89-3fa7-4ac6-a25d-53919912eaee): created successfully Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6b57b5-bd55-4e1d-9df9-e44eca7cf02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Flow 'volume_create_manager' (57d369e0-1fb3-4065-a4e4-a7bc6ae6dd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:20 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e 1073741824 Jul 05 05:19:20 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-11d12859-4975-42c3-b16c-c11437c7c737 tempest-TestStampPattern-536924063 None] Created volume successfully. Jul 05 05:19:20 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:22 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e 1073741824" returned: 0 in 1.337s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:22 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e Jul 05 05:19:22 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:23 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" returned: 0 in 0.828s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:19:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1d3555-698e-4777-b37d-efa78fb66d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082a0b05-e0be-4407-afac-554756cf0159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Volume volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e (6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e): created successfully Jul 05 05:19:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082a0b05-e0be-4407-afac-554756cf0159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Flow 'volume_create_manager' (494dd2af-e110-4ed2-ba18-1d441e327087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-dd105f60-ba4f-497e-bc66-1baa4d3976b8 tempest-GroupSnapshotsV319Test-39411769 None] Created volume successfully. Jul 05 05:19:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] GroupSnapshot 142ec373-7e8a-4a38-b667-0ef4ea6d44f4: creating. Jul 05 05:19:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Group snapshot 142ec373-7e8a-4a38-b667-0ef4ea6d44f4: creating. {{(pid=86688) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 05:19:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Creating offline snapshot 7db7a899-3ae8-4bb3-96d0-36ac8bdec35f of volume 6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:19:24 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf7dfc4-9fae-49f3-a174-1bfce92bcb1f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:24 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e Jul 05 05:19:24 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:25 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" returned: 0 in 0.909s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:25 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f 1G Jul 05 05:19:25 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f 1G" returned: 0 in 1.113s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:26 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:26 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f Jul 05 05:19:26 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:27 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" returned: 0 in 1.019s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:27 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:19:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:27 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f Jul 05 05:19:27 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:29 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" returned: 0 in 1.438s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:29 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.info Jul 05 05:19:29 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Flow 'volume_create_manager' (c9552754-320e-4320-8e7b-127cb42f8688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f13b758-d782-4c66-b36f-67c55efdbbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f13b758-d782-4c66-b36f-67c55efdbbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1948457844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71f8bfb-09a0-42e6-9a76-e514ee00b243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e02b7447b61f4b0e85695f6cf633a0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:30Z,use_quota=True,user_id='e698ecd85b3e41b6859f034f4813a145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524da7a7-dd30-437e-8c14-236c9b6fdf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524da7a7-dd30-437e-8c14-236c9b6fdf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77959e30-0933-4b8a-ba45-45ff5f6ddb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:19:30 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.info" returned: 0 in 1.009s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:30 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:30 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.info Jul 05 05:19:30 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:30 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:19:30 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77959e30-0933-4b8a-ba45-45ff5f6ddb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c71f8bfb-09a0-42e6-9a76-e514ee00b243', 'volume_name': 'volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1da22f-38bb-4465-83b1-6fcdcb270c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1da22f-38bb-4465-83b1-6fcdcb270c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2222260b-4e99-4ba7-b8d6-1ab2b86fc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:30 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Volume c71f8bfb-09a0-42e6-9a76-e514ee00b243: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 05:19:30 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Trying to clone c71f8bfb-09a0-42e6-9a76-e514ee00b243 from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:19:31 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Image download 20.69 MB at 20.69 MB/s Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[26846ce0-a552-4b32-909d-31df1709cc63]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:31 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.info" returned: 0 in 1.183s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.830s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:31 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.123s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:19:31 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a9937c4f-9f04-4bc8-a197-a7ea3505fb01 tempest-GroupSnapshotsV319Test-39411769 None] group_snapshot 142ec373-7e8a-4a38-b667-0ef4ea6d44f4: created successfully Jul 05 05:19:31 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD Jul 05 05:19:31 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:19:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:19:32 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e is fetched for user e698ecd85b3e41b6859f034f4813a145. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c2ee8-b2ca-4778-a5df-6b7e4231e38d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:32 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD Jul 05 05:19:32 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] group_snapshot 142ec373-7e8a-4a38-b667-0ef4ea6d44f4: deleting Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] group_snapshot 142ec373-7e8a-4a38-b667-0ef4ea6d44f4: deleting {{(pid=86688) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Acquiring lock "cinder-quobyte-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Lock "cinder-quobyte-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Acquiring lock "cinder-quobyte-7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Lock "cinder-quobyte-7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Deleting offline snapshot 7db7a899-3ae8-4bb3-96d0-36ac8bdec35f of volume 6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] snapshot_file for this snap is: volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[893df2ff-af30-43a5-a92a-ee25826d0dc2]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:33 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f Jul 05 05:19:33 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:33 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD" returned: 0 in 1.004s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1948457844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71f8bfb-09a0-42e6-9a76-e514ee00b243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e02b7447b61f4b0e85695f6cf633a0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:30Z,use_quota=True,user_id='e698ecd85b3e41b6859f034f4813a145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Creating volume c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:19:33 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:33 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 1073741824 Jul 05 05:19:33 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:33 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" returned: 0 in 1.066s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17ae966-3c44-47d2-9e3a-853a6d77aa27]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:34 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e Jul 05 05:19:34 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:34 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 1073741824" returned: 0 in 1.071s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:34 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 Jul 05 05:19:34 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:34 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" returned: 0 in 0.935s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:34 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f Jul 05 05:19:34 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:35 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243" returned: 0 in 1.149s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:19:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:35 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Attempting download of 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume c71f8bfb-09a0-42e6-9a76-e514ee00b243. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:19:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ee19aa-e7d9-45c1-9230-0bdb8ac6fc12]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e__rjtlaim {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:36 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e__rjtlaim Jul 05 05:19:36 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:36 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" returned: 0 in 1.321s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:36 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f Jul 05 05:19:36 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:36 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e__rjtlaim" returned: 0 in 1.007s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e__rjtlaim {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:37 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e__rjtlaim Jul 05 05:19:37 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:37 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e.7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" returned: 0 in 0.892s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Lock "cinder-quobyte-7db7a899-3ae8-4bb3-96d0-36ac8bdec35f" released by "_delete_snapshot" :: held 4.336s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Lock "cinder-quobyte-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" released by "delete_snapshot" :: held 4.367s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:37 devstack cinder-volume[86688]: WARNING cinder.quota [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1746214339 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1746214339, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:37 devstack cinder-volume[86688]: WARNING cinder.quota [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1746214339 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1746214339, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] Created reservations ['3abedb4b-15e3-43ea-9279-78d88ce36b9b', 'e10f689b-4210-4cf9-82df-e3426343820f', '3fa062be-f034-40fd-ba1f-9f3ab6bb4809', 'f936fa10-84e3-4d90-b001-27f3b7431396'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d8e54cf4-eb75-418f-b9da-ee1e377f6a21 tempest-GroupSnapshotsV319Test-39411769 None] group_snapshot 142ec373-7e8a-4a38-b667-0ef4ea6d44f4: deleted successfully Jul 05 05:19:37 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e__rjtlaim" returned: 1 in 0.987s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e__rjtlaim' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[733acce2-f4fd-4c0e-bad2-17dfbe7c3406]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:38 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD Jul 05 05:19:38 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Acquiring lock "cinder-quobyte-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Lock "cinder-quobyte-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" acquired by "delete_volume" :: waited 0.043s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:39 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dbd205-a2de-4476-8e52-8497c70a77ed]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:39 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD" returned: 0 in 1.172s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:39 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e was qcow2, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:19:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:39 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e Jul 05 05:19:39 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:39 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 Jul 05 05:19:39 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:39 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" returned: 0 in 0.995s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:40 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e Jul 05 05:19:40 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:41 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" returned: 0 in 1.353s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Lock "cinder-quobyte-6fe8a835-a8b5-4fb7-bc0a-286aa4f0e10e" released by "delete_volume" :: held 2.486s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Created reservations ['2443206c-89ef-44bb-9fb3-0bb125e477fd'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:41 devstack cinder-volume[86688]: WARNING cinder.quota [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1746214339 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1746214339, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Created reservations ['cc532cb5-90c2-4f58-ae25-14a885e131c3', '18ff3b59-610a-4bcc-9cdc-5b38c58271ff', '1f60a50f-fe09-473e-8c4e-27d1335e0391', '0c6c2931-563d-410a-85c8-2c1a8db7f00b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:41 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:19:41 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:42 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243" returned: 0 in 3.387s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:42 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_ya9k11aodevstack@QuobyteHD, size 112.00 MB, duration 3.39 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:19:42 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Converted 112.00 MB image at 33.06 MB/s Jul 05 05:19:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:42 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 1G Jul 05 05:19:42 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:43 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.560s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:43 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:19:43 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c3241b3a-f368-4fc6-88a0-a8c812950af5 tempest-GroupSnapshotsV319Test-39411769 None] Delete group completed successfully. Jul 05 05:19:44 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 1G" returned: 0 in 1.810s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f421c09-37b0-4b19-ab82-7bada95932c0]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:44 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 Jul 05 05:19:44 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:45 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243" returned: 0 in 1.261s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:45 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 Jul 05 05:19:45 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:46 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243" returned: 1 in 1.114s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:19:46 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Downloaded image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume c71f8bfb-09a0-42e6-9a76-e514ee00b243 successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:19:46 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e for user e698ecd85b3e41b6859f034f4813a145 is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:19:46 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Marking volume c71f8bfb-09a0-42e6-9a76-e514ee00b243 as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:19:46 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Copying metadata from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e to c71f8bfb-09a0-42e6-9a76-e514ee00b243. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:19:46 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Creating volume glance metadata for volume c71f8bfb-09a0-42e6-9a76-e514ee00b243 backed by image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:19:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2222260b-4e99-4ba7-b8d6-1ab2b86fc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17796c5-f24b-46de-a794-6c19ec132c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:47 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Volume volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 (c71f8bfb-09a0-42e6-9a76-e514ee00b243): created successfully Jul 05 05:19:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17796c5-f24b-46de-a794-6c19ec132c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Flow 'volume_create_manager' (c9552754-320e-4320-8e7b-127cb42f8688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d99bd932-1a35-4789-9247-e85d7ebbb6f3 tempest-VolumesImageMetadata-362898593 None] Created volume successfully. Jul 05 05:19:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Acquiring lock "cinder-c71f8bfb-09a0-42e6-9a76-e514ee00b243-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Lock "cinder-c71f8bfb-09a0-42e6-9a76-e514ee00b243-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Acquiring lock "cinder-quobyte-c71f8bfb-09a0-42e6-9a76-e514ee00b243" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:19:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Lock "cinder-quobyte-c71f8bfb-09a0-42e6-9a76-e514ee00b243" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:19:48 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a48349-d103-4295-8bfb-05640ee39a53]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:19:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:48 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 Jul 05 05:19:48 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:49 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243" returned: 0 in 0.982s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:50 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 Jul 05 05:19:50 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:51 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243" returned: 1 in 1.282s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:19:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:51 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243 Jul 05 05:19:51 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:51 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c71f8bfb-09a0-42e6-9a76-e514ee00b243" returned: 0 in 0.830s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Lock "cinder-quobyte-c71f8bfb-09a0-42e6-9a76-e514ee00b243" released by "delete_volume" :: held 3.184s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Created reservations ['743f2132-dbbd-48c2-8d4d-a83cbe068a09', '3fbca23a-79ae-4e4a-ae77-2eeebec60fd4', 'f77e8f65-d4fd-4d5e-ba20-52750e474138', '8f29383b-f77f-47ad-835a-fa5cd55c35ba'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:52 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:19:52 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:19:52 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.685s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:19:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Deleted volume successfully. Jul 05 05:19:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5cc4028c-047d-428d-bf7e-460ee9c74a12 tempest-VolumesImageMetadata-362898593 None] Lock "cinder-c71f8bfb-09a0-42e6-9a76-e514ee00b243-delete_volume" released by "delete_volume" :: held 4.183s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Flow 'volume_create_manager' (7a25d4d1-56ba-4950-a098-80f675aaf0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450eba20-8265-449e-a3e5-2b55b2bae504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450eba20-8265-449e-a3e5-2b55b2bae504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1840299163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22838fa-c082-4806-b4a6-4fa0a9b3123c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe31624a5b54c3eac2b10c3ed34a7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:59Z,use_quota=True,user_id='90315c19c73145e6be92f6425b50b85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b18c98-2a56-4eea-8b62-c4c9b69831b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b18c98-2a56-4eea-8b62-c4c9b69831b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a261f883-90dc-4960-b327-aa466ea74ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a261f883-90dc-4960-b327-aa466ea74ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22838fa-c082-4806-b4a6-4fa0a9b3123c', 'volume_name': 'volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f32953-31bf-4010-8bfd-97a96ad5f3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f32953-31bf-4010-8bfd-97a96ad5f3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477ecae0-2b41-4c8d-b819-cc55825d7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:19:59 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Volume a22838fa-c082-4806-b4a6-4fa0a9b3123c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c', 'volume_size': 1} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1840299163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22838fa-c082-4806-b4a6-4fa0a9b3123c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe31624a5b54c3eac2b10c3ed34a7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:19:59Z,use_quota=True,user_id='90315c19c73145e6be92f6425b50b85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Creating volume a22838fa-c082-4806-b4a6-4fa0a9b3123c {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:19:59 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:19:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:19:59 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c 1073741824 Jul 05 05:19:59 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:00 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c 1073741824" returned: 0 in 1.193s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:01 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c Jul 05 05:20:01 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:01 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c" returned: 0 in 0.941s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477ecae0-2b41-4c8d-b819-cc55825d7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b14a7f-63ed-4215-b55f-a1e68c3ba3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:01 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Volume volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c (a22838fa-c082-4806-b4a6-4fa0a9b3123c): created successfully Jul 05 05:20:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b14a7f-63ed-4215-b55f-a1e68c3ba3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Flow 'volume_create_manager' (7a25d4d1-56ba-4950-a098-80f675aaf0e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-70aa1363-f000-4fa2-b00d-08ad44ba9596 tempest-VolumesTransfersTest-857328480 None] Created volume successfully. Jul 05 05:20:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-bef8646e-312b-4ce8-bde6-90121b73f084 req-e2b18a15-7583-44ed-aa33-3d9092f325d8 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-bef8646e-312b-4ce8-bde6-90121b73f084 req-e2b18a15-7583-44ed-aa33-3d9092f325d8 tempest-TestStampPattern-536924063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:03 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4837a9b-580c-4a0c-b148-f3a6e82f655f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-bef8646e-312b-4ce8-bde6-90121b73f084 req-e2b18a15-7583-44ed-aa33-3d9092f325d8 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:03 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:20:03 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-812f9063-6038-424c-a6c4-fb92b2096c25 tempest-VolumesTransfersTest-1478187512 None] Transfer volume completed successfully. Jul 05 05:20:04 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-bef8646e-312b-4ce8-bde6-90121b73f084 req-e2b18a15-7583-44ed-aa33-3d9092f325d8 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 1.055s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-bef8646e-312b-4ce8-bde6-90121b73f084 req-e2b18a15-7583-44ed-aa33-3d9092f325d8 tempest-TestStampPattern-536924063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.144s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-bef8646e-312b-4ce8-bde6-90121b73f084 req-e2b18a15-7583-44ed-aa33-3d9092f325d8 tempest-TestStampPattern-536924063 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53523248-aca5-4fa2-8643-eaab1d51bb93', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:20:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-bef8646e-312b-4ce8-bde6-90121b73f084 req-e2b18a15-7583-44ed-aa33-3d9092f325d8 tempest-TestStampPattern-536924063 None] attachment_update completed successfully. Jul 05 05:20:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Acquiring lock "cinder-a22838fa-c082-4806-b4a6-4fa0a9b3123c-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Lock "cinder-a22838fa-c082-4806-b4a6-4fa0a9b3123c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Acquiring lock "cinder-quobyte-a22838fa-c082-4806-b4a6-4fa0a9b3123c" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Lock "cinder-quobyte-a22838fa-c082-4806-b4a6-4fa0a9b3123c" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d0fafd-411d-4af6-9e00-b6701244357a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:05 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c Jul 05 05:20:05 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:06 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c" returned: 0 in 1.009s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:06 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c Jul 05 05:20:06 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:07 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a22838fa-c082-4806-b4a6-4fa0a9b3123c" returned: 0 in 0.719s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Lock "cinder-quobyte-a22838fa-c082-4806-b4a6-4fa0a9b3123c" released by "delete_volume" :: held 1.789s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Created reservations ['80fde1f9-5650-4424-9db8-46008e3f6d69', 'e3c77319-ffc4-48e6-84d9-e3ec71bb7726', '23c20d71-5241-4429-a1ea-16c1c1cc999e', '082401d1-daf6-48c8-8461-d0040c052ae5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:07 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:07 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:08 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.729s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Deleted volume successfully. Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-74774033-0d9d-4632-afd7-7b67993198b9 tempest-VolumesTransfersTest-221824971 None] Lock "cinder-a22838fa-c082-4806-b4a6-4fa0a9b3123c-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Flow 'volume_create_manager' (b12979cc-bdf0-4b6a-b73c-87aef2f30ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f1785-8aa3-4223-9f9c-0532eb3149db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f1785-8aa3-4223-9f9c-0532eb3149db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-698891557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8927e1a-7d40-4659-9f61-e5ea47573e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe31624a5b54c3eac2b10c3ed34a7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:08Z,use_quota=True,user_id='90315c19c73145e6be92f6425b50b85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bde1c3-3deb-47a4-857a-6b4a63ffe9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bde1c3-3deb-47a4-857a-6b4a63ffe9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73469f6-6aeb-4d53-9403-c6042b8ff93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73469f6-6aeb-4d53-9403-c6042b8ff93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8927e1a-7d40-4659-9f61-e5ea47573e2e', 'volume_name': 'volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f8bcfd-1d1c-4d12-9165-45f4de393c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f8bcfd-1d1c-4d12-9165-45f4de393c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bec7ea-d52b-45c6-977f-4063086f722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:08 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Volume e8927e1a-7d40-4659-9f61-e5ea47573e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e', 'volume_size': 1} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-698891557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8927e1a-7d40-4659-9f61-e5ea47573e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe31624a5b54c3eac2b10c3ed34a7e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:08Z,use_quota=True,user_id='90315c19c73145e6be92f6425b50b85a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Creating volume e8927e1a-7d40-4659-9f61-e5ea47573e2e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:08 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:08 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e 1073741824 Jul 05 05:20:08 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:09 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e 1073741824" returned: 0 in 0.916s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:09 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e Jul 05 05:20:09 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:10 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e" returned: 0 in 0.723s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98bec7ea-d52b-45c6-977f-4063086f722f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25dbeff-7685-4c90-b883-7e55b4c19957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:10 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Volume volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e (e8927e1a-7d40-4659-9f61-e5ea47573e2e): created successfully Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25dbeff-7685-4c90-b883-7e55b4c19957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Flow 'volume_create_manager' (b12979cc-bdf0-4b6a-b73c-87aef2f30ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0575df20-cb58-4ff4-af2e-6a9201e5a5e3 tempest-VolumesTransfersTest-857328480 None] Created volume successfully. Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Acquiring lock "cinder-e8927e1a-7d40-4659-9f61-e5ea47573e2e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Lock "cinder-e8927e1a-7d40-4659-9f61-e5ea47573e2e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Acquiring lock "cinder-quobyte-e8927e1a-7d40-4659-9f61-e5ea47573e2e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Lock "cinder-quobyte-e8927e1a-7d40-4659-9f61-e5ea47573e2e" acquired by "delete_volume" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e752848e-c6eb-45c8-8d5b-d9dd394ea51e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:11 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e Jul 05 05:20:11 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:12 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e" returned: 0 in 1.128s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:12 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e Jul 05 05:20:12 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:13 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8927e1a-7d40-4659-9f61-e5ea47573e2e" returned: 0 in 1.120s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Lock "cinder-quobyte-e8927e1a-7d40-4659-9f61-e5ea47573e2e" released by "delete_volume" :: held 2.337s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Created reservations ['470788c2-976e-4768-930d-4782bd9382b1', '3f389ca4-14f6-43be-8287-248d8e5b1137', '7f4119a8-8a9a-487e-8e20-e16985fc34a7', '277fd15e-2720-45ce-8c73-26bec8ae135a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:13 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:13 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:14 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.806s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:14 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Deleted volume successfully. Jul 05 05:20:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-875e7e23-e313-4ff3-843f-5926702c14cd tempest-VolumesTransfersTest-221824971 None] Lock "cinder-e8927e1a-7d40-4659-9f61-e5ea47573e2e-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-befbd071-2bfa-47aa-aad1-dbd9c1bbc0eb req-fe0d9c3f-1ea7-4557-b7ff-692e6f6cb95b tempest-TestStampPattern-536924063 None] Terminate volume connection completed successfully. Jul 05 05:20:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-befbd071-2bfa-47aa-aad1-dbd9c1bbc0eb req-fe0d9c3f-1ea7-4557-b7ff-692e6f6cb95b tempest-TestStampPattern-536924063 None] Deleting attachment 53523248-aca5-4fa2-8643-eaab1d51bb93. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:20:16 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=71,cinder:INSERT=22,cinder:UPDATE=71,cinder:DELETE=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:20:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Creating offline snapshot d0495d41-e62b-4bdb-9eaa-17f893b7efb6 of volume b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:20:16 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74aff4c-b19d-4246-acee-42635fc126fc]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:16 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:20:16 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:18 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 1.300s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:18 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 1G Jul 05 05:20:18 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:INSERT=22,cinder:UPDATE=69,cinder:SELECT=63,cinder:DELETE=2 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Flow 'volume_create_manager' (6e1bb624-eddf-41e9-af42-d5cfa31f5f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637d6df1-21a7-42d1-9fd6-ed03c0d9c7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637d6df1-21a7-42d1-9fd6-ed03c0d9c7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1039814245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c373d9b-2664-477c-85db-555aedf730db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a33b737a12a4909b42889bbb1fea5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:18Z,use_quota=True,user_id='ddd92d1e776247e3b8ed273bbff6c103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5c52f3-0597-4397-b2e7-1716c208e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5c52f3-0597-4397-b2e7-1716c208e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d3e72c-3748-4d51-97af-57c6489a4544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d3e72c-3748-4d51-97af-57c6489a4544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c373d9b-2664-477c-85db-555aedf730db', 'volume_name': 'volume-7c373d9b-2664-477c-85db-555aedf730db', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec32aef-8133-4f5e-91f5-e826a3419016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec32aef-8133-4f5e-91f5-e826a3419016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fe9f42-b981-42cb-bf3a-0b69aa10b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:18 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Volume 7c373d9b-2664-477c-85db-555aedf730db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c373d9b-2664-477c-85db-555aedf730db', 'volume_size': 1} Jul 05 05:20:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:19 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 1G" returned: 0 in 1.182s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:19 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 Jul 05 05:20:19 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:20 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6" returned: 0 in 0.842s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:20 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 is being set with open permissions: ugo+rw Jul 05 05:20:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:20 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 Jul 05 05:20:20 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:20 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6" returned: 0 in 0.818s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:21 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.info Jul 05 05:20:21 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:21 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.info" returned: 0 in 0.876s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:21 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.info is being set with open permissions: ugo+rw Jul 05 05:20:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:21 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.info Jul 05 05:20:21 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (f4187227-5821-4dd7-b3b2-c96bd203542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487bacad-3932-4f6b-be65-7ccad888882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487bacad-3932-4f6b-be65-7ccad888882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480505989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba94f94c-2a4b-48d4-a1ee-6c97bbc11624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:22Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a8c843-b917-48ec-8fdb-25c717b8659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a8c843-b917-48ec-8fdb-25c717b8659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03013ef8-1e17-4237-80fb-4a0ec988a028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03013ef8-1e17-4237-80fb-4a0ec988a028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba94f94c-2a4b-48d4-a1ee-6c97bbc11624', 'volume_name': 'volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0f43b5-1428-4b3d-a3e2-764122ed504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0f43b5-1428-4b3d-a3e2-764122ed504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b72414-13df-43f6-b365-cbccbfe43460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:22 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Volume ba94f94c-2a4b-48d4-a1ee-6c97bbc11624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624', 'volume_size': 1} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:22 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.info" returned: 0 in 1.058s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.189s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.430s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1039814245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c373d9b-2664-477c-85db-555aedf730db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a33b737a12a4909b42889bbb1fea5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:18Z,use_quota=True,user_id='ddd92d1e776247e3b8ed273bbff6c103',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Creating volume 7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:22 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:23 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db 1073741824 Jul 05 05:20:23 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d1e2e4d3-0c0a-4021-8368-edfd60ec1c88 tempest-TestStampPattern-536924063 None] Create snapshot completed successfully Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Flow 'volume_create_manager' (6645ad78-008f-41e6-9ae5-30a85d3ee15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b6ee03-fc99-429b-a4ff-f7c6b9010d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b6ee03-fc99-429b-a4ff-f7c6b9010d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-215148385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151d7dbc-b346-4588-9610-c5218eb0f595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a680e5b7a3b4a6eaa57d1a26c7368fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:24Z,use_quota=True,user_id='2067097e49fe47288d1b4db2a1ba3dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb05688f-7df7-45c1-9d92-e232858be99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb05688f-7df7-45c1-9d92-e232858be99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb35c29-3bd7-477a-a9b3-af6beaf50bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb35c29-3bd7-477a-a9b3-af6beaf50bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151d7dbc-b346-4588-9610-c5218eb0f595', 'volume_name': 'volume-151d7dbc-b346-4588-9610-c5218eb0f595', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e2c7d1-6be6-4e64-91c1-f48c5bccaad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e2c7d1-6be6-4e64-91c1-f48c5bccaad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e01e2c-0a5b-4fd3-832c-bcfc7d3d7093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Volume 151d7dbc-b346-4588-9610-c5218eb0f595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151d7dbc-b346-4588-9610-c5218eb0f595', 'volume_size': 1} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:23 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db 1073741824" returned: 0 in 0.962s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:23 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db Jul 05 05:20:23 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:24 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db" returned: 0 in 0.676s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.921s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480505989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba94f94c-2a4b-48d4-a1ee-6c97bbc11624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:22Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Creating volume ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:24 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:24 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 1073741824 Jul 05 05:20:24 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fe9f42-b981-42cb-bf3a-0b69aa10b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c373d9b-2664-477c-85db-555aedf730db', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91853be-ed06-4c0f-bb3e-49fd557b5c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:24 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Volume volume-7c373d9b-2664-477c-85db-555aedf730db (7c373d9b-2664-477c-85db-555aedf730db): created successfully Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91853be-ed06-4c0f-bb3e-49fd557b5c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Flow 'volume_create_manager' (6e1bb624-eddf-41e9-af42-d5cfa31f5f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c1327bdd-8e4c-4884-9e99-d54216a2c881 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Created volume successfully. Jul 05 05:20:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:25 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 1073741824" returned: 0 in 1.130s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:25 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 Jul 05 05:20:25 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:26 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" returned: 0 in 0.763s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.690s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-215148385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151d7dbc-b346-4588-9610-c5218eb0f595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a680e5b7a3b4a6eaa57d1a26c7368fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:24Z,use_quota=True,user_id='2067097e49fe47288d1b4db2a1ba3dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Creating volume 151d7dbc-b346-4588-9610-c5218eb0f595 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:26 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:26 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 1073741824 Jul 05 05:20:26 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b72414-13df-43f6-b365-cbccbfe43460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01682b1a-6e1f-4d14-a1b7-70cc7b2ce085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:26 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Volume volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 (ba94f94c-2a4b-48d4-a1ee-6c97bbc11624): created successfully Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01682b1a-6e1f-4d14-a1b7-70cc7b2ce085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (f4187227-5821-4dd7-b3b2-c96bd203542f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e906e4da-a1df-4619-88d5-07a892e9c964 tempest-VolumesActionsTest-1741350936 None] Created volume successfully. Jul 05 05:20:27 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 1073741824" returned: 0 in 0.990s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:27 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 Jul 05 05:20:27 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fda7a743-d751-4890-86fc-a5f6c63026bd tempest-VolumesActionsTest-1741350936 None] Acquiring lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" by "attach_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fda7a743-d751-4890-86fc-a5f6c63026bd tempest-VolumesActionsTest-1741350936 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" acquired by "attach_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fda7a743-d751-4890-86fc-a5f6c63026bd tempest-VolumesActionsTest-1741350936 None] Attaching volume ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 to instance 79403f7c-f8d4-4e03-87ac-c8cbcc5fe859 at mountpoint /dev/vdb on host None. Jul 05 05:20:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fda7a743-d751-4890-86fc-a5f6c63026bd tempest-VolumesActionsTest-1741350936 None] Attach volume completed successfully. Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fda7a743-d751-4890-86fc-a5f6c63026bd tempest-VolumesActionsTest-1741350936 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" released by "attach_volume" :: held 0.199s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:28 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595" returned: 0 in 0.820s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.119s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e01e2c-0a5b-4fd3-832c-bcfc7d3d7093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151d7dbc-b346-4588-9610-c5218eb0f595', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdd0a03-0f8c-4076-bf88-f1dce4248912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Creating offline snapshot a0c5d653-4f82-42e9-8903-1679c7a29fe6 of volume 7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:20:28 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Volume volume-151d7dbc-b346-4588-9610-c5218eb0f595 (151d7dbc-b346-4588-9610-c5218eb0f595): created successfully Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fdd0a03-0f8c-4076-bf88-f1dce4248912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Flow 'volume_create_manager' (6645ad78-008f-41e6-9ae5-30a85d3ee15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a8b83-bf9f-42da-8368-b0edfded6ca3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-eff24013-b1b5-4797-8769-f1b95e5b6e3b tempest-VolumesTransfersV355Test-868646352 None] Created volume successfully. Jul 05 05:20:28 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db Jul 05 05:20:28 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fa61f004-c4d9-4fb2-b53d-660aabee0857 tempest-VolumesActionsTest-1810773890 None] Terminate volume connection completed successfully. Jul 05 05:20:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fa61f004-c4d9-4fb2-b53d-660aabee0857 tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-detach_volume" by "detach_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fa61f004-c4d9-4fb2-b53d-660aabee0857 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fa61f004-c4d9-4fb2-b53d-660aabee0857 tempest-VolumesActionsTest-1810773890 None] Detaching volume ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 from instance 79403f7c-f8d4-4e03-87ac-c8cbcc5fe859. Jul 05 05:20:29 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db" returned: 0 in 1.130s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fa61f004-c4d9-4fb2-b53d-660aabee0857 tempest-VolumesActionsTest-1810773890 None] Detach volume completed successfully. Jul 05 05:20:29 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 1G Jul 05 05:20:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fa61f004-c4d9-4fb2-b53d-660aabee0857 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-detach_volume" released by "detach_volume" :: held 0.199s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:29 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-2e9ec74b-2474-462e-96ff-dd7cb42aa1ea tempest-VolumesTransfersV355Test-27960913 None] Transfer volume completed successfully. Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bf14089c-705c-47eb-b537-a09fbdf9a53e tempest-VolumesActionsTest-1741350936 None] Acquiring lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-detach_volume" by "detach_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bf14089c-705c-47eb-b537-a09fbdf9a53e tempest-VolumesActionsTest-1741350936 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bf14089c-705c-47eb-b537-a09fbdf9a53e tempest-VolumesActionsTest-1741350936 None] Volume detach called, but volume not attached. Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bf14089c-705c-47eb-b537-a09fbdf9a53e tempest-VolumesActionsTest-1741350936 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:30 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:30 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:31 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 1G" returned: 0 in 1.294s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c373d9b-2664-477c-85db-555aedf730db -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:31 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c373d9b-2664-477c-85db-555aedf730db -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 Jul 05 05:20:31 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Acquiring lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Acquiring lock "cinder-quobyte-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Lock "cinder-quobyte-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" acquired by "delete_volume" :: waited 0.034s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Acquiring lock "cinder-151d7dbc-b346-4588-9610-c5218eb0f595-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[61588bc8-a5f8-4fb4-88f1-2b13978493e3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-151d7dbc-b346-4588-9610-c5218eb0f595-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Acquiring lock "cinder-quobyte-151d7dbc-b346-4588-9610-c5218eb0f595" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-quobyte-151d7dbc-b346-4588-9610-c5218eb0f595" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e1c384-9d45-4ed2-8a3a-ee7ae8b2a07a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:31 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 Jul 05 05:20:31 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:31 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.411s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:20:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:20:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:20:32 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 Jul 05 05:20:32 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:32 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c373d9b-2664-477c-85db-555aedf730db -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6" returned: 0 in 1.579s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:32 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 is being set with open permissions: ugo+rw Jul 05 05:20:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:32 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 Jul 05 05:20:32 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:33 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595" returned: 0 in 1.256s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:33 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" returned: 0 in 1.482s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:33 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595 Jul 05 05:20:33 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:33 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624 Jul 05 05:20:33 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:33 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6" returned: 0 in 0.923s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:33 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.info Jul 05 05:20:33 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:33 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-151d7dbc-b346-4588-9610-c5218eb0f595" returned: 0 in 0.804s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-quobyte-151d7dbc-b346-4588-9610-c5218eb0f595" released by "delete_volume" :: held 2.145s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:33 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" returned: 0 in 0.811s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Lock "cinder-quobyte-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624" released by "delete_volume" :: held 2.398s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Created reservations ['1c9b3932-9e02-422d-95df-00555b2db458', 'b8056339-62f2-4935-801e-0db513d2424e', 'eb6698ae-e91f-4cb3-b366-d20b8cdecae3', '09781275-3d22-496a-b64f-1c7d6ae4c2d5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Created reservations ['37786c66-dd25-439e-9339-4cd04d8a6606', 'd659fe5d-47cc-41b2-ab33-bce934a79842', '5503fc7c-06c8-43c8-842e-f64f4dbd78a4', '6a9aa764-a209-464c-b9f1-be68ccc59960'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:34 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:34 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:34 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:34 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:34 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.info" returned: 0 in 0.981s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:34 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.info is being set with open permissions: ugo+rw Jul 05 05:20:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:34 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.info Jul 05 05:20:34 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:34 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.850s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Deleted volume successfully. Jul 05 05:20:35 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.802s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1bad15ef-35ac-424a-816a-ee5612dbb49a tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-151d7dbc-b346-4588-9610-c5218eb0f595-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Deleted volume successfully. Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-453561ad-29ec-4429-be5f-c6c84793713e tempest-VolumesActionsTest-1741350936 None] Lock "cinder-ba94f94c-2a4b-48d4-a1ee-6c97bbc11624-delete_volume" released by "delete_volume" :: held 3.641s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:35 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.info" returned: 0 in 0.912s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-cc20af5a-38b0-44af-93fc-f6421fd66799 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Create snapshot completed successfully Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Flow 'volume_create_manager' (9854f28b-70a0-4ba1-ba43-2f9bae135e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95defbad-7cee-4bfb-9537-4c5db5807956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95defbad-7cee-4bfb-9537-4c5db5807956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1691158811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb064306-9cdb-4716-bfd8-1af8af443bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a680e5b7a3b4a6eaa57d1a26c7368fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:36Z,use_quota=True,user_id='2067097e49fe47288d1b4db2a1ba3dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a925fa8-9685-4a1a-be7c-86082308c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a925fa8-9685-4a1a-be7c-86082308c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193549a1-06d2-4e19-8f76-6edc26b8ba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193549a1-06d2-4e19-8f76-6edc26b8ba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb064306-9cdb-4716-bfd8-1af8af443bfd', 'volume_name': 'volume-eb064306-9cdb-4716-bfd8-1af8af443bfd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6e3dd-f1fa-4d93-98e6-6b19001174d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6e3dd-f1fa-4d93-98e6-6b19001174d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01cddb6-8574-4799-bfe2-fd6639298aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Volume eb064306-9cdb-4716-bfd8-1af8af443bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb064306-9cdb-4716-bfd8-1af8af443bfd', 'volume_size': 1} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1691158811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb064306-9cdb-4716-bfd8-1af8af443bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a680e5b7a3b4a6eaa57d1a26c7368fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:36Z,use_quota=True,user_id='2067097e49fe47288d1b4db2a1ba3dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Creating volume eb064306-9cdb-4716-bfd8-1af8af443bfd {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:35 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:35 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd 1073741824 Jul 05 05:20:35 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Flow 'volume_create_manager' (48d4fe1d-1a03-4035-9f8e-4b9de689b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59056c6d-f627-4824-a888-4da3a97eee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59056c6d-f627-4824-a888-4da3a97eee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-462364069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499d22a3-60e9-4905-ac3e-39a40b7f8902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db98ed1cb513415c9389b6f2e967a54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d0495d41-e62b-4bdb-9eaa-17f893b7efb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:37Z,use_quota=True,user_id='3cbe4d2b2b9f4328a7dfdae27bd215bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539ce5dd-a812-48d6-be65-6439f827adff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539ce5dd-a812-48d6-be65-6439f827adff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e404329-bb2e-4789-a5e8-b99cf2ba355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e404329-bb2e-4789-a5e8-b99cf2ba355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '499d22a3-60e9-4905-ac3e-39a40b7f8902', 'volume_name': 'volume-499d22a3-60e9-4905-ac3e-39a40b7f8902', 'volume_size': 1, 'snapshot_id': 'd0495d41-e62b-4bdb-9eaa-17f893b7efb6'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db214ef-e044-468e-a3ea-2e2a175d1f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db214ef-e044-468e-a3ea-2e2a175d1f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af556848-27d3-426b-be2d-e6839911d73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Volume 499d22a3-60e9-4905-ac3e-39a40b7f8902: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-499d22a3-60e9-4905-ac3e-39a40b7f8902', 'volume_size': 1, 'snapshot_id': 'd0495d41-e62b-4bdb-9eaa-17f893b7efb6'} Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:36 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd 1073741824" returned: 0 in 1.065s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:37 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd Jul 05 05:20:37 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "cinder-a0c5d653-4f82-42e9-8903-1679c7a29fe6-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-a0c5d653-4f82-42e9-8903-1679c7a29fe6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "cinder-quobyte-7c373d9b-2664-477c-85db-555aedf730db" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-quobyte-7c373d9b-2664-477c-85db-555aedf730db" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "cinder-quobyte-a0c5d653-4f82-42e9-8903-1679c7a29fe6" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-quobyte-a0c5d653-4f82-42e9-8903-1679c7a29fe6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Deleting offline snapshot a0c5d653-4f82-42e9-8903-1679c7a29fe6 of volume 7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] snapshot_file for this snap is: volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8175455d-3d8d-4135-af0c-4d1f5da60514]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:37 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 Jul 05 05:20:37 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:37 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd" returned: 0 in 0.921s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.090s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-quobyte-d0495d41-e62b-4bdb-9eaa-17f893b7efb6-499d22a3-60e9-4905-ac3e-39a40b7f8902" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01cddb6-8574-4799-bfe2-fd6639298aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb064306-9cdb-4716-bfd8-1af8af443bfd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b9e0d8-cc26-47c8-9d79-1f280c52a354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-d0495d41-e62b-4bdb-9eaa-17f893b7efb6-499d22a3-60e9-4905-ac3e-39a40b7f8902" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Creating volume 499d22a3-60e9-4905-ac3e-39a40b7f8902 from snapshot d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-quobyte-499d22a3-60e9-4905-ac3e-39a40b7f8902" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Volume volume-eb064306-9cdb-4716-bfd8-1af8af443bfd (eb064306-9cdb-4716-bfd8-1af8af443bfd): created successfully Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b9e0d8-cc26-47c8-9d79-1f280c52a354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Flow 'volume_create_manager' (9854f28b-70a0-4ba1-ba43-2f9bae135e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-499d22a3-60e9-4905-ac3e-39a40b7f8902" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] snapshot: d0495d41-e62b-4bdb-9eaa-17f893b7efb6, volume: 499d22a3-60e9-4905-ac3e-39a40b7f8902, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:20:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-35bbc322-be0b-4c0c-97e1-0426fbc04a89 tempest-VolumesTransfersV355Test-868646352 None] Created volume successfully. Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c8eec2-add3-4466-a1c9-65727b72b93b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:38 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 Jul 05 05:20:38 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:38 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6" returned: 0 in 1.266s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c373d9b-2664-477c-85db-555aedf730db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d15b9d1-fcf0-4ee9-8f7f-edd64a77d4d5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:38 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db Jul 05 05:20:38 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:39 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6" returned: 0 in 1.076s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf816891-79cd-4b49-a11c-ce9746276d4a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:39 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:20:39 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Acquiring lock "cinder-eb064306-9cdb-4716-bfd8-1af8af443bfd-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-eb064306-9cdb-4716-bfd8-1af8af443bfd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Acquiring lock "cinder-quobyte-eb064306-9cdb-4716-bfd8-1af8af443bfd" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-quobyte-eb064306-9cdb-4716-bfd8-1af8af443bfd" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[649b92e9-3da2-4cc1-b572-05f66c6cb2f3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:39 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd Jul 05 05:20:39 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:39 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db" returned: 0 in 0.988s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:39 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 Jul 05 05:20:39 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:40 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 1.041s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:40 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:20:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:40 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 Jul 05 05:20:40 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:40 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd" returned: 0 in 0.983s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:40 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd Jul 05 05:20:40 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:40 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6" returned: 0 in 0.892s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:40 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6 Jul 05 05:20:40 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:41 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb064306-9cdb-4716-bfd8-1af8af443bfd" returned: 0 in 0.826s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-quobyte-eb064306-9cdb-4716-bfd8-1af8af443bfd" released by "delete_volume" :: held 1.929s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Created reservations ['ae93cf2b-4fdd-4339-a02b-378f4a0be606', '25a508b7-8cca-4b93-aa57-1410f7c0e62a', '315e6d51-4cf5-4d88-b776-63d7d86f03a8', '9e2b4aab-0466-4ae4-a950-17551f67c680'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:41 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:41 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:42 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db.a0c5d653-4f82-42e9-8903-1679c7a29fe6" returned: 0 in 1.581s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-quobyte-a0c5d653-4f82-42e9-8903-1679c7a29fe6" released by "_delete_snapshot" :: held 4.964s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-quobyte-7c373d9b-2664-477c-85db-555aedf730db" released by "delete_snapshot" :: held 4.996s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:42 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Created reservations ['90963aaa-9e4c-483b-901a-d1a3ee2d0df4', '2d7d06df-63e0-4465-a057-334ca97a9201', 'b7f4f99b-8e79-41f7-8e74-53aa4d4aca8a', 'ed876cac-7ae1-4dcc-84d8-2cd0ad46492d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Delete snapshot completed successfully. Jul 05 05:20:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bcbbfc33-94a2-4b33-8284-45df8d4f1e2d tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-a0c5d653-4f82-42e9-8903-1679c7a29fe6-delete_snapshot" released by "delete_snapshot" :: held 5.483s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:43 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.215s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:43 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:43 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Deleted volume successfully. Jul 05 05:20:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f5947614-1528-4187-9376-4ae67815c6c2 tempest-VolumesTransfersV355Test-239954981 None] Lock "cinder-eb064306-9cdb-4716-bfd8-1af8af443bfd-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "cinder-7c373d9b-2664-477c-85db-555aedf730db-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-7c373d9b-2664-477c-85db-555aedf730db-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "cinder-quobyte-7c373d9b-2664-477c-85db-555aedf730db" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-quobyte-7c373d9b-2664-477c-85db-555aedf730db" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1eaa27-71c1-4b9d-9f98-c391e8f8f27e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:45 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db Jul 05 05:20:45 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (78a12b88-06ef-41e2-a7cf-f992d26a08c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16838e8-6ff0-4595-9c35-e4e58dd78058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16838e8-6ff0-4595-9c35-e4e58dd78058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899187297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585d11d8-eac4-4882-9e79-8b16cb766921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:45Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea79b95-947b-4f6b-b1b5-d63ad44e0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea79b95-947b-4f6b-b1b5-d63ad44e0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbd70b9-fae2-4292-902d-2b18d3b0be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecbd70b9-fae2-4292-902d-2b18d3b0be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585d11d8-eac4-4882-9e79-8b16cb766921', 'volume_name': 'volume-585d11d8-eac4-4882-9e79-8b16cb766921', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db69377-a4ee-4cf4-9547-558c604eeb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db69377-a4ee-4cf4-9547-558c604eeb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb95e512-1bc3-4009-9868-e9d1ab6141c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:45 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Volume 585d11d8-eac4-4882-9e79-8b16cb766921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585d11d8-eac4-4882-9e79-8b16cb766921', 'volume_size': 1} Jul 05 05:20:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:47 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db" returned: 0 in 3.006s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:47 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db Jul 05 05:20:47 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:47 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902" returned: 0 in 7.538s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e395c0-2c80-48a8-979a-b0174c1277b4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:48 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:20:48 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:49 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7c373d9b-2664-477c-85db-555aedf730db" returned: 0 in 1.511s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-quobyte-7c373d9b-2664-477c-85db-555aedf730db" released by "delete_volume" :: held 4.736s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Created reservations ['535c79dd-aacb-44d7-b8c8-780ce8969868', '982be5f5-e172-4950-bbf7-f47d93f30153', 'c635f929-9eca-4be3-a886-aa6ac9d1d9aa', '2a56b4b7-5332-4e3d-8b53-da244fbe9094'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:49 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 1.485s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:20:49 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Converted 1024.00 MB image at 135.82 MB/s Jul 05 05:20:49 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 is being set with open permissions: ugo+rw Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:49 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 Jul 05 05:20:49 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:49 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:49 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:50 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.971s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:50 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902" returned: 0 in 1.122s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Deleted volume successfully. Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-499d22a3-60e9-4905-ac3e-39a40b7f8902" released by "_copy_volume_from_snapshot" :: held 12.449s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-d0495d41-e62b-4bdb-9eaa-17f893b7efb6-499d22a3-60e9-4905-ac3e-39a40b7f8902" released by "_create_volume_from_snapshot" :: held 12.544s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.611s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.628s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899187297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585d11d8-eac4-4882-9e79-8b16cb766921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:45Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Creating volume 585d11d8-eac4-4882-9e79-8b16cb766921 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:50 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3e7a35cb-e626-4ab6-9b38-1029835b5a51 tempest-VolumeSnapshotQuotasNegativeTestJSON-880629489 None] Lock "cinder-7c373d9b-2664-477c-85db-555aedf730db-delete_volume" released by "delete_volume" :: held 6.292s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:50 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 1073741824 Jul 05 05:20:50 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af556848-27d3-426b-be2d-e6839911d73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499d22a3-60e9-4905-ac3e-39a40b7f8902', 'volume_size': 1, 'snapshot_id': 'd0495d41-e62b-4bdb-9eaa-17f893b7efb6'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f081c3-16d9-4b96-821b-8972df512920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Volume volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 (499d22a3-60e9-4905-ac3e-39a40b7f8902): created successfully Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f081c3-16d9-4b96-821b-8972df512920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Flow 'volume_create_manager' (48d4fe1d-1a03-4035-9f8e-4b9de689b659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4eadb21f-7711-4701-8cd2-4e150afecc09 tempest-TestStampPattern-536924063 None] Created volume successfully. Jul 05 05:20:51 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 1073741824" returned: 0 in 1.215s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:51 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 Jul 05 05:20:51 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:52 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921" returned: 0 in 0.933s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] <== create_volume: return (2211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb95e512-1bc3-4009-9868-e9d1ab6141c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585d11d8-eac4-4882-9e79-8b16cb766921', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b744a5f-4209-4066-a001-3af238dcdd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:52 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Volume volume-585d11d8-eac4-4882-9e79-8b16cb766921 (585d11d8-eac4-4882-9e79-8b16cb766921): created successfully Jul 05 05:20:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b744a5f-4209-4066-a001-3af238dcdd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (78a12b88-06ef-41e2-a7cf-f992d26a08c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-21484a1d-6051-4aba-ba21-6ba4978a66fc tempest-VolumesActionsTest-1741350936 None] Created volume successfully. Jul 05 05:20:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-585d11d8-eac4-4882-9e79-8b16cb766921-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-585d11d8-eac4-4882-9e79-8b16cb766921-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-quobyte-585d11d8-eac4-4882-9e79-8b16cb766921" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:20:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-585d11d8-eac4-4882-9e79-8b16cb766921" acquired by "delete_volume" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:20:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bceb33e-8bac-4dd5-8fa6-a2ef6ed803cb]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:20:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:53 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 Jul 05 05:20:53 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:54 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921" returned: 0 in 1.270s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:55 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921 Jul 05 05:20:55 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:55 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-585d11d8-eac4-4882-9e79-8b16cb766921" returned: 0 in 0.904s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-585d11d8-eac4-4882-9e79-8b16cb766921" released by "delete_volume" :: held 2.262s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:55 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Created reservations ['18107264-01c0-4daa-a30b-8eea4ba90d13', 'b85dfe59-ec95-4e49-9d62-ffb7a353f242', '2efe914e-be75-46ff-b853-88b46935be2c', '17f64958-082d-43c5-a6f7-e097be6145de'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:56 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:20:56 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Flow 'volume_create_manager' (eb465313-2554-47f6-87b1-dded2a4249dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d3dc6b-a193-480e-ab18-1bc3755360eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d3dc6b-a193-480e-ab18-1bc3755360eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1854395621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f120e5d-0739-4ffe-a517-a3530ed6aae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafcbc84ce2d49d998b272721d444e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:57Z,use_quota=True,user_id='feca9da368994dbda91480353c07a79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878fb0e2-08a7-4564-a5b3-a436313bce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878fb0e2-08a7-4564-a5b3-a436313bce28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9467ad7d-1d5c-4586-bf32-1673319af475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9467ad7d-1d5c-4586-bf32-1673319af475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f120e5d-0739-4ffe-a517-a3530ed6aae3', 'volume_name': 'volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58ae81d-7efd-406c-82bf-a2ad34f5a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58ae81d-7efd-406c-82bf-a2ad34f5a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814dfc02-c1d7-4fbb-b3b7-0da8c4f72b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:56 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Volume 1f120e5d-0739-4ffe-a517-a3530ed6aae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3', 'volume_size': 1} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1854395621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f120e5d-0739-4ffe-a517-a3530ed6aae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafcbc84ce2d49d998b272721d444e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:57Z,use_quota=True,user_id='feca9da368994dbda91480353c07a79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Creating volume 1f120e5d-0739-4ffe-a517-a3530ed6aae3 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:56 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:57 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 1073741824 Jul 05 05:20:57 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:57 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.055s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:57 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:20:57 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Deleted volume successfully. Jul 05 05:20:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ecc1842d-0911-4eb6-9be3-ef2624184b28 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-585d11d8-eac4-4882-9e79-8b16cb766921-delete_volume" released by "delete_volume" :: held 3.764s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (d4576e6f-f9ca-4314-a61c-7572ba08a454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ff30d5-aaab-44dd-86aa-d6d74a2cb995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ff30d5-aaab-44dd-86aa-d6d74a2cb995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928043863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa14e19-c027-4280-95c4-806e2d0a34d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:58Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d5dac7-8b73-49ad-861e-7d169356d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d5dac7-8b73-49ad-861e-7d169356d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b7b66a-8b66-4298-a157-4eb7e33bbdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b7b66a-8b66-4298-a157-4eb7e33bbdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa14e19-c027-4280-95c4-806e2d0a34d6', 'volume_name': 'volume-dfa14e19-c027-4280-95c4-806e2d0a34d6', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4183f12-cca9-4bdb-9641-9c62dbebceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4183f12-cca9-4bdb-9641-9c62dbebceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b695613-d3f9-43d4-994d-3d3c0857690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Volume dfa14e19-c027-4280-95c4-806e2d0a34d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa14e19-c027-4280-95c4-806e2d0a34d6', 'volume_size': 1} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:58 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 1073741824" returned: 0 in 1.390s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:58 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 Jul 05 05:20:58 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:59 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3" returned: 0 in 0.998s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] <== create_volume: return (2448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-928043863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa14e19-c027-4280-95c4-806e2d0a34d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:20:58Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Creating volume dfa14e19-c027-4280-95c4-806e2d0a34d6 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:20:59 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814dfc02-c1d7-4fbb-b3b7-0da8c4f72b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6038b11b-4724-4849-b6bd-5c218e1ab4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:20:59 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 1073741824 Jul 05 05:20:59 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:20:59 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Volume volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 (1f120e5d-0739-4ffe-a517-a3530ed6aae3): created successfully Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6038b11b-4724-4849-b6bd-5c218e1ab4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:20:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Flow 'volume_create_manager' (eb465313-2554-47f6-87b1-dded2a4249dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:20:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3985631b-fae4-4138-8c01-a94d13239532 tempest-VolumesTransfersV357Test-1278509476 None] Created volume successfully. Jul 05 05:21:01 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 1073741824" returned: 0 in 1.669s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:01 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 Jul 05 05:21:01 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:01 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4dfc6eb4-15de-40cf-bde9-2600eb350347 tempest-VolumesTransfersV357Test-1805556489 None] Transfer volume completed successfully. Jul 05 05:21:02 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6" returned: 0 in 1.011s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] <== create_volume: return (2801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.811s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b695613-d3f9-43d4-994d-3d3c0857690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa14e19-c027-4280-95c4-806e2d0a34d6', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d918102-17b4-49a8-b9de-98b5a94ba6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:02 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Volume volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 (dfa14e19-c027-4280-95c4-806e2d0a34d6): created successfully Jul 05 05:21:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d918102-17b4-49a8-b9de-98b5a94ba6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (d4576e6f-f9ca-4314-a61c-7572ba08a454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3264ddcf-1cbd-4ac2-816d-bd3eac5decdf tempest-VolumesActionsTest-1741350936 None] Created volume successfully. Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Acquiring lock "cinder-1f120e5d-0739-4ffe-a517-a3530ed6aae3-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-1f120e5d-0739-4ffe-a517-a3530ed6aae3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Acquiring lock "cinder-quobyte-1f120e5d-0739-4ffe-a517-a3530ed6aae3" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-quobyte-1f120e5d-0739-4ffe-a517-a3530ed6aae3" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7b4147-a367-4f0a-99fc-10cccf86d6cf]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:03 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 Jul 05 05:21:03 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-dfa14e19-c027-4280-95c4-806e2d0a34d6-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-dfa14e19-c027-4280-95c4-806e2d0a34d6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-quobyte-dfa14e19-c027-4280-95c4-806e2d0a34d6" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-dfa14e19-c027-4280-95c4-806e2d0a34d6" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:04 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3110cef-fd53-4740-a063-56160b27d76a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:04 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 Jul 05 05:21:04 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:04 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3" returned: 0 in 1.232s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:04 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3 Jul 05 05:21:04 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:05 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6" returned: 0 in 1.096s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:05 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6 Jul 05 05:21:05 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:05 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1f120e5d-0739-4ffe-a517-a3530ed6aae3" returned: 0 in 0.853s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-quobyte-1f120e5d-0739-4ffe-a517-a3530ed6aae3" released by "delete_volume" :: held 2.162s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Created reservations ['58a40e9f-09dd-4543-b2f0-399cc3b5c16a', '8fabe16d-1363-46d3-a00a-7a746ea2167a', '61944af2-0106-4212-80ee-687c042297d8', '17847823-21ed-4a8c-97e5-b3e8c8df292c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Flow 'volume_create_manager' (e60783d3-3aea-4c7a-a3ea-821baa76fc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf81e468-0f4e-4ed4-bd88-537220a397a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf81e468-0f4e-4ed4-bd88-537220a397a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1852209349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7915730f-5dbb-44b8-afe4-9c174a544679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade7ad74e8f240baa76836bc3a468f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:05Z,use_quota=True,user_id='e4e7d24e88b3405e954bf6c5816c2699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51fcf9d-5cf0-4590-b8ad-e67e7c2a24d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51fcf9d-5cf0-4590-b8ad-e67e7c2a24d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1427b145-461c-46ed-9ec1-ec1c35e1a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1427b145-461c-46ed-9ec1-ec1c35e1a28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7915730f-5dbb-44b8-afe4-9c174a544679', 'volume_name': 'volume-7915730f-5dbb-44b8-afe4-9c174a544679', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349f7592-766b-4bac-bd6d-392c38d2dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349f7592-766b-4bac-bd6d-392c38d2dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9a1e8b-27a6-4695-816c-bd66717026db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:05 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Volume 7915730f-5dbb-44b8-afe4-9c174a544679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7915730f-5dbb-44b8-afe4-9c174a544679', 'volume_size': 1} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1852209349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7915730f-5dbb-44b8-afe4-9c174a544679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade7ad74e8f240baa76836bc3a468f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:05Z,use_quota=True,user_id='e4e7d24e88b3405e954bf6c5816c2699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Creating volume 7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:05 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:05 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 1073741824 Jul 05 05:21:05 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:05 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:05 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:05 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dfa14e19-c027-4280-95c4-806e2d0a34d6" returned: 0 in 0.828s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-dfa14e19-c027-4280-95c4-806e2d0a34d6" released by "delete_volume" :: held 1.983s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Created reservations ['d7af460f-3e2d-453b-a252-8293171498f9', 'baf26cba-9bb7-4053-a972-9dad17e862ec', 'aadadf7e-dba9-4bff-b2ae-c064a929a82c', 'd421d8d6-bb12-4376-b016-b9a244ec8e77'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:06 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:06 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:06 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.883s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:06 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Deleted volume successfully. Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6fa2384-a413-48cb-b43a-7299977e2eb8 tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-1f120e5d-0739-4ffe-a517-a3530ed6aae3-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:06 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 1073741824" returned: 0 in 1.212s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:06 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 Jul 05 05:21:06 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:07 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.930s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Deleted volume successfully. Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-03b9f3b3-d203-4c8d-b987-dcfbb6243cf4 tempest-VolumesActionsTest-1810773890 None] Lock "cinder-dfa14e19-c027-4280-95c4-806e2d0a34d6-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Flow 'volume_create_manager' (86503430-cb60-4398-b8f9-f6a25f53355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14df2f21-1e2b-4833-ba57-c8961113b21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14df2f21-1e2b-4833-ba57-c8961113b21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1315225242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e4bbe9-8cdb-4dca-ae66-a017ef4c320f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafcbc84ce2d49d998b272721d444e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:07Z,use_quota=True,user_id='feca9da368994dbda91480353c07a79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29eadb7-54bc-4c46-a0b9-31d53c8a2b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29eadb7-54bc-4c46-a0b9-31d53c8a2b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcf6170-6798-4c0b-aaea-694d35b9ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcf6170-6798-4c0b-aaea-694d35b9ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e4bbe9-8cdb-4dca-ae66-a017ef4c320f', 'volume_name': 'volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8cdee9-b023-4476-acf6-30cfee99164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8cdee9-b023-4476-acf6-30cfee99164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeea456d-9ac9-4dcc-b329-2896e7211b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Volume 22e4bbe9-8cdb-4dca-ae66-a017ef4c320f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f', 'volume_size': 1} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:07 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679" returned: 0 in 0.886s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.238s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1315225242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e4bbe9-8cdb-4dca-ae66-a017ef4c320f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafcbc84ce2d49d998b272721d444e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:07Z,use_quota=True,user_id='feca9da368994dbda91480353c07a79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Creating volume 22e4bbe9-8cdb-4dca-ae66-a017ef4c320f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:07 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9a1e8b-27a6-4695-816c-bd66717026db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7915730f-5dbb-44b8-afe4-9c174a544679', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef41057-554e-48cc-8d9e-b747f93e3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f 1073741824 Jul 05 05:21:07 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:07 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Volume volume-7915730f-5dbb-44b8-afe4-9c174a544679 (7915730f-5dbb-44b8-afe4-9c174a544679): created successfully Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef41057-554e-48cc-8d9e-b747f93e3c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Flow 'volume_create_manager' (e60783d3-3aea-4c7a-a3ea-821baa76fc71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-129d73f5-62cd-4159-a329-4727b36d3f73 tempest-SnapshotMetadataTestJSON-169817728 None] Created volume successfully. Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (af7953e8-5461-4953-a11a-39aeb9400d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2212e58-3f6e-4651-8517-5e9db44adda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2212e58-3f6e-4651-8517-5e9db44adda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-794677250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3cc091-0493-4368-b09e-cd73ebbad222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:08Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412f2aa0-1592-431a-80fd-bbb4a35071c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412f2aa0-1592-431a-80fd-bbb4a35071c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d538a-555a-4552-bd58-b116ccc6bd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d538a-555a-4552-bd58-b116ccc6bd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3cc091-0493-4368-b09e-cd73ebbad222', 'volume_name': 'volume-7d3cc091-0493-4368-b09e-cd73ebbad222', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508d1821-fba2-4ed5-a6b6-14d0185c823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (508d1821-fba2-4ed5-a6b6-14d0185c823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142adbcf-1a28-4f0b-8afb-9390253c134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:07 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Volume 7d3cc091-0493-4368-b09e-cd73ebbad222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3cc091-0493-4368-b09e-cd73ebbad222', 'volume_size': 1} Jul 05 05:21:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:08 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f 1073741824" returned: 0 in 0.938s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:08 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f Jul 05 05:21:08 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:09 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f" returned: 0 in 0.704s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-794677250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3cc091-0493-4368-b09e-cd73ebbad222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:08Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Creating volume 7d3cc091-0493-4368-b09e-cd73ebbad222 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:09 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeea456d-9ac9-4dcc-b329-2896e7211b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:09 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 1073741824 Jul 05 05:21:09 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2aa5227-6863-4de1-85a6-3e2c9555b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Volume volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f (22e4bbe9-8cdb-4dca-ae66-a017ef4c320f): created successfully Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2aa5227-6863-4de1-85a6-3e2c9555b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Flow 'volume_create_manager' (86503430-cb60-4398-b8f9-f6a25f53355a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d4ca00a6-f099-4b90-879c-ae2bcc5abdd0 tempest-VolumesTransfersV357Test-1278509476 None] Created volume successfully. Jul 05 05:21:10 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 1073741824" returned: 0 in 0.853s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:10 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 Jul 05 05:21:10 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Acquiring lock "cinder-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Acquiring lock "cinder-quobyte-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-quobyte-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccb0fab-c4c7-4636-8e37-839f00329de5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:10 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f Jul 05 05:21:10 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:10 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222" returned: 0 in 0.675s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.204s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142adbcf-1a28-4f0b-8afb-9390253c134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3cc091-0493-4368-b09e-cd73ebbad222', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a2f037-ea01-42dd-bc81-46c2710760a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Creating offline snapshot 500c9ece-af2c-45fc-bc5b-9087b2caa224 of volume 7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:21:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Volume volume-7d3cc091-0493-4368-b09e-cd73ebbad222 (7d3cc091-0493-4368-b09e-cd73ebbad222): created successfully Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a2f037-ea01-42dd-bc81-46c2710760a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (af7953e8-5461-4953-a11a-39aeb9400d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013043f-17ab-4eec-a6dc-4fa8fec60936]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-445916d1-1825-4cab-ba30-f47bc4a96116 tempest-VolumesActionsTest-1741350936 None] Created volume successfully. Jul 05 05:21:11 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 Jul 05 05:21:11 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:11 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f" returned: 0 in 0.802s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:11 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f Jul 05 05:21:11 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:11 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679" returned: 0 in 0.811s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:11 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 1G Jul 05 05:21:11 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-7d3cc091-0493-4368-b09e-cd73ebbad222-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Lock "cinder-7d3cc091-0493-4368-b09e-cd73ebbad222-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-quobyte-7d3cc091-0493-4368-b09e-cd73ebbad222" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-7d3cc091-0493-4368-b09e-cd73ebbad222" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[842a0398-4576-4d2d-b58f-bebaa19d7fe5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:12 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f" returned: 0 in 0.746s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-quobyte-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f" released by "delete_volume" :: held 1.586s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Created reservations ['a62175ab-692f-4a23-99f2-bf155c5ee36d', '25abe475-be33-4d14-8f52-241314e27acf', '8faf1ac6-464c-45c2-810a-fa3f778b1c3c', '8b1d62b5-6bfe-4ad6-9fbd-5ed1472b8da1'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:12 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 Jul 05 05:21:12 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:12 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:12 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:12 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 1G" returned: 0 in 0.907s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7915730f-5dbb-44b8-afe4-9c174a544679 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:12 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7915730f-5dbb-44b8-afe4-9c174a544679 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 Jul 05 05:21:12 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:13 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222" returned: 0 in 0.860s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:13 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222 Jul 05 05:21:13 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:13 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.803s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Deleted volume successfully. Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-87ae4f79-a41a-4af2-be99-6b5d16e7abaa tempest-VolumesTransfersV357Test-962443889 None] Lock "cinder-22e4bbe9-8cdb-4dca-ae66-a017ef4c320f-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:13 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7915730f-5dbb-44b8-afe4-9c174a544679 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224" returned: 0 in 0.786s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:13 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 is being set with open permissions: ugo+rw Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:13 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 Jul 05 05:21:13 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:13 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7d3cc091-0493-4368-b09e-cd73ebbad222" returned: 0 in 0.752s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-7d3cc091-0493-4368-b09e-cd73ebbad222" released by "delete_volume" :: held 1.671s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Created reservations ['a8f40a59-c8a7-4c8d-84c3-67181a8dcd68', 'a43a9b4c-159b-4c8a-bc88-e4d4839c069b', 'f97eb02f-c551-4b8c-b578-2ca72dec3009', '350e7a79-8c95-478b-bf44-fe63a73c8400'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:14 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:14 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:14 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224" returned: 0 in 0.682s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:14 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.info Jul 05 05:21:14 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:14 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.746s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Deleted volume successfully. Jul 05 05:21:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff98d81c-809e-4bcc-9167-6733aa0d4f4e tempest-VolumesActionsTest-1810773890 None] Lock "cinder-7d3cc091-0493-4368-b09e-cd73ebbad222-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:15 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.info" returned: 0 in 0.849s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:15 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.info is being set with open permissions: ugo+rw Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:15 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.info Jul 05 05:21:15 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (2352b67c-1fcc-4beb-aaec-9bf025920e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0c4545-ba06-4a31-8fcd-d6f0abd8355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0c4545-ba06-4a31-8fcd-d6f0abd8355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2029103015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d252b4-3eec-4ea7-b579-14f1a8c05184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:15Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5951340a-8276-41cc-ad31-83c967d6509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5951340a-8276-41cc-ad31-83c967d6509f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7daa2-d120-4594-b022-2051eebb8494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7daa2-d120-4594-b022-2051eebb8494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d252b4-3eec-4ea7-b579-14f1a8c05184', 'volume_name': 'volume-44d252b4-3eec-4ea7-b579-14f1a8c05184', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34f97d6-434a-492c-9afb-d31587bc0500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34f97d6-434a-492c-9afb-d31587bc0500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33dd468-e227-4f54-bc42-29453f114dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:15 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Volume 44d252b4-3eec-4ea7-b579-14f1a8c05184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d252b4-3eec-4ea7-b579-14f1a8c05184', 'volume_size': 1} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:15 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.info" returned: 0 in 0.724s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2029103015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d252b4-3eec-4ea7-b579-14f1a8c05184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:15Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Creating volume 44d252b4-3eec-4ea7-b579-14f1a8c05184 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:15 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:15 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 1073741824 Jul 05 05:21:15 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5f83b9f8-accf-4db0-be01-5bec888ce14a tempest-SnapshotMetadataTestJSON-169817728 None] Create snapshot completed successfully Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "cinder-500c9ece-af2c-45fc-bc5b-9087b2caa224-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-500c9ece-af2c-45fc-bc5b-9087b2caa224-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "cinder-quobyte-7915730f-5dbb-44b8-afe4-9c174a544679" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:16 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-quobyte-7915730f-5dbb-44b8-afe4-9c174a544679" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "cinder-quobyte-500c9ece-af2c-45fc-bc5b-9087b2caa224" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 1073741824" returned: 0 in 1.081s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=121,cinder:SELECT=95,cinder:INSERT=27,cinder:DELETE=11 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-quobyte-500c9ece-af2c-45fc-bc5b-9087b2caa224" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Deleting offline snapshot 500c9ece-af2c-45fc-bc5b-9087b2caa224 of volume 7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] snapshot_file for this snap is: volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb7e932-f9d1-496c-9365-2a9b33db9e97]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:17 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 Jul 05 05:21:17 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:17 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 Jul 05 05:21:17 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:17 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184" returned: 0 in 0.736s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33dd468-e227-4f54-bc42-29453f114dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d252b4-3eec-4ea7-b579-14f1a8c05184', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90da4e68-57e9-4f61-9c8d-9df2bbc2cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:17 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Volume volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 (44d252b4-3eec-4ea7-b579-14f1a8c05184): created successfully Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90da4e68-57e9-4f61-9c8d-9df2bbc2cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (2352b67c-1fcc-4beb-aaec-9bf025920e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-77f6c095-8fb0-4d13-b50e-9d7a9b97600f tempest-VolumesActionsTest-1741350936 None] Created volume successfully. Jul 05 05:21:17 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224" returned: 0 in 0.929s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7915730f-5dbb-44b8-afe4-9c174a544679(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[51772730-7b8a-4884-bf25-4e60d5b76eb6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:18 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 Jul 05 05:21:18 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-44d252b4-3eec-4ea7-b579-14f1a8c05184-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Lock "cinder-44d252b4-3eec-4ea7-b579-14f1a8c05184-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=91,cinder:UPDATE=119,cinder:INSERT=29,cinder:DELETE=13 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Acquiring lock "cinder-quobyte-44d252b4-3eec-4ea7-b579-14f1a8c05184" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-44d252b4-3eec-4ea7-b579-14f1a8c05184" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aabec2a-2a6f-4566-8383-7137a0c35f09]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:18 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 Jul 05 05:21:18 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:18 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:18 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 Jul 05 05:21:18 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:19 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184" returned: 0 in 0.840s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:19 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184 Jul 05 05:21:19 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:19 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:19 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224 Jul 05 05:21:19 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:20 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-44d252b4-3eec-4ea7-b579-14f1a8c05184" returned: 0 in 0.851s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Lock "cinder-quobyte-44d252b4-3eec-4ea7-b579-14f1a8c05184" released by "delete_volume" :: held 1.746s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Created reservations ['1ce561ae-5015-450a-b7a3-29e9cfd5118e', 'af637316-852f-463b-9c7f-4633adabf05a', '224338b6-bb56-49ea-b4e1-ffcf1e65ab2a', '68d4f654-a497-4de8-83b8-5c6ff2dfb335'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:20 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679.500c9ece-af2c-45fc-bc5b-9087b2caa224" returned: 0 in 0.844s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:20 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:20 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-quobyte-500c9ece-af2c-45fc-bc5b-9087b2caa224" released by "_delete_snapshot" :: held 3.645s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-quobyte-7915730f-5dbb-44b8-afe4-9c174a544679" released by "delete_snapshot" :: held 3.683s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Created reservations ['f7e6f035-4b23-4848-8b3a-2885f0a55a1b', '285a3900-72b3-4915-a3e2-eb77c4741ff6', '1d208c30-84d4-4694-8dd4-fc610eee5509', 'd5dd2b57-8760-4cb0-9267-0d4c2bf54e87'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:20 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Delete snapshot completed successfully. Jul 05 05:21:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a2c7addc-16de-4d9b-9b05-d682e1c6c78f tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-500c9ece-af2c-45fc-bc5b-9087b2caa224-delete_snapshot" released by "delete_snapshot" :: held 3.887s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "cinder-7915730f-5dbb-44b8-afe4-9c174a544679-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-7915730f-5dbb-44b8-afe4-9c174a544679-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "cinder-quobyte-7915730f-5dbb-44b8-afe4-9c174a544679" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-quobyte-7915730f-5dbb-44b8-afe4-9c174a544679" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd65434-195e-493e-afa7-be4348c5eeba]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (3ca08c06-cde8-471c-948c-b8098a76caeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54383005-2bde-45bb-8704-ee236f9750c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:21 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.282s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54383005-2bde-45bb-8704-ee236f9750c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1988164970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e92f57-441a-47c6-b16d-126d642151cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:22Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e813c22-eb95-4864-8185-161c9d15ee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e813c22-eb95-4864-8185-161c9d15ee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db307f7a-651e-4ac2-8118-850a28e59d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db307f7a-651e-4ac2-8118-850a28e59d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e92f57-441a-47c6-b16d-126d642151cb', 'volume_name': 'volume-c6e92f57-441a-47c6-b16d-126d642151cb', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1151d3-4386-49e2-9754-dcb44f8be0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1151d3-4386-49e2-9754-dcb44f8be0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd477c9-1f18-40f7-ab1d-65735f3be5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:21 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 Jul 05 05:21:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Volume c6e92f57-441a-47c6-b16d-126d642151cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e92f57-441a-47c6-b16d-126d642151cb', 'volume_size': 1} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:21 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1988164970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e92f57-441a-47c6-b16d-126d642151cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14233e85093c48ac906acd6cd9090187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:22Z,use_quota=True,user_id='a4662aba79c54f28ae5ea7c1c14a2256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Creating volume c6e92f57-441a-47c6-b16d-126d642151cb {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:21 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Deleted volume successfully. Jul 05 05:21:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72f54733-5bcc-4d3f-843c-7fc94a49778b tempest-VolumesActionsTest-1810773890 None] Lock "cinder-44d252b4-3eec-4ea7-b579-14f1a8c05184-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:21 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb 1073741824 Jul 05 05:21:21 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:22 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679" returned: 0 in 0.959s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:22 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679 Jul 05 05:21:22 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:23 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb 1073741824" returned: 0 in 1.148s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:23 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb Jul 05 05:21:23 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:23 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7915730f-5dbb-44b8-afe4-9c174a544679" returned: 0 in 0.704s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-quobyte-7915730f-5dbb-44b8-afe4-9c174a544679" released by "delete_volume" :: held 1.752s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Created reservations ['385e79e9-7624-44ee-ad1d-3f207e93ee26', '667218cf-726e-40ae-9776-82adbd58cb43', 'be6d476d-69e3-4d31-ba51-a2aa1bbe66a7', 'cb4320e1-f850-45d0-9cab-3f15f7d8a5e4'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:23 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:23 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:23 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb" returned: 0 in 0.752s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd477c9-1f18-40f7-ab1d-65735f3be5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e92f57-441a-47c6-b16d-126d642151cb', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeec00a0-79d1-4582-b8b5-653014335aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Volume volume-c6e92f57-441a-47c6-b16d-126d642151cb (c6e92f57-441a-47c6-b16d-126d642151cb): created successfully Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeec00a0-79d1-4582-b8b5-653014335aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Flow 'volume_create_manager' (3ca08c06-cde8-471c-948c-b8098a76caeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-019572dd-7246-49f0-96f9-4f2c4deffe26 tempest-VolumesActionsTest-1741350936 None] Created volume successfully. Jul 05 05:21:24 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.837s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:24 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Deleted volume successfully. Jul 05 05:21:24 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3081fbd-7d84-4014-b061-e52f3806093e tempest-SnapshotMetadataTestJSON-169817728 None] Lock "cinder-7915730f-5dbb-44b8-afe4-9c174a544679-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "cinder-c6e92f57-441a-47c6-b16d-126d642151cb-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Lock "cinder-c6e92f57-441a-47c6-b16d-126d642151cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "cinder-quobyte-c6e92f57-441a-47c6-b16d-126d642151cb" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Lock "cinder-quobyte-c6e92f57-441a-47c6-b16d-126d642151cb" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3354c5d-385f-4849-b0fa-4557fbbc3d66]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:26 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb Jul 05 05:21:26 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:26 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb" returned: 0 in 0.985s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:26 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb Jul 05 05:21:26 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:27 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6e92f57-441a-47c6-b16d-126d642151cb" returned: 0 in 1.069s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Lock "cinder-quobyte-c6e92f57-441a-47c6-b16d-126d642151cb" released by "delete_volume" :: held 2.129s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Created reservations ['d573f893-aff6-4f04-8109-cf6dccb78964', '8c6c37ef-0b18-4b59-8adc-351cbd9eef15', 'c263d3c0-9e3c-4842-907e-3de2077b0e39', '9f4f8ab6-5892-408e-bdc4-68564a18362e'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-217c0f88-916e-4bf9-92a2-f03d7b0ba319 req-ad6022ec-6bf3-4813-9701-5a690619a67a tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-217c0f88-916e-4bf9-92a2-f03d7b0ba319 req-ad6022ec-6bf3-4813-9701-5a690619a67a tempest-TestStampPattern-536924063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb97583-aca5-4d7c-8679-8561b1d1cc09]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-217c0f88-916e-4bf9-92a2-f03d7b0ba319 req-ad6022ec-6bf3-4813-9701-5a690619a67a tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:28 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:28 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:28 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 Jul 05 05:21:28 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:29 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.920s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:29 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Deleted volume successfully. Jul 05 05:21:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-37d4d233-bf00-4cf1-acdd-a0fe396dc8b4 tempest-VolumesActionsTest-1741350936 None] Lock "cinder-c6e92f57-441a-47c6-b16d-126d642151cb-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:29 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-217c0f88-916e-4bf9-92a2-f03d7b0ba319 req-ad6022ec-6bf3-4813-9701-5a690619a67a tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902" returned: 0 in 1.216s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-217c0f88-916e-4bf9-92a2-f03d7b0ba319 req-ad6022ec-6bf3-4813-9701-5a690619a67a tempest-TestStampPattern-536924063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.244s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-217c0f88-916e-4bf9-92a2-f03d7b0ba319 req-ad6022ec-6bf3-4813-9701-5a690619a67a tempest-TestStampPattern-536924063 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-499d22a3-60e9-4905-ac3e-39a40b7f8902', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4272ee6d-eeb0-4070-9101-596324649273', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:21:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-217c0f88-916e-4bf9-92a2-f03d7b0ba319 req-ad6022ec-6bf3-4813-9701-5a690619a67a tempest-TestStampPattern-536924063 None] attachment_update completed successfully. Jul 05 05:21:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:21:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:30 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:30 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:31 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.089s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:21:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:21:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Flow 'volume_create_manager' (8cd063ee-ec1b-40ca-b997-4b055cc4c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c4e16a-44f6-4d42-badd-870b63b6e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c4e16a-44f6-4d42-badd-870b63b6e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034304838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b604bd59-cb9e-44bd-b699-553e50b4cd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f695e69074e1420ba06563953c402c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:34Z,use_quota=True,user_id='279952d933e746d4813cddd2b09922cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2292623c-363f-4c12-b751-0de15b1833c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2292623c-363f-4c12-b751-0de15b1833c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125108a7-1cf6-426e-9f0a-f3825209380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125108a7-1cf6-426e-9f0a-f3825209380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b604bd59-cb9e-44bd-b699-553e50b4cd7a', 'volume_name': 'volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a87c8ff-866a-497e-98c2-818e787f7bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a87c8ff-866a-497e-98c2-818e787f7bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50650427-d6cd-4f58-9ad6-33ea0f75aa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:34 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Volume b604bd59-cb9e-44bd-b699-553e50b4cd7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a', 'volume_size': 1} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034304838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b604bd59-cb9e-44bd-b699-553e50b4cd7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f695e69074e1420ba06563953c402c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:34Z,use_quota=True,user_id='279952d933e746d4813cddd2b09922cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Creating volume b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:34 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:34 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a 1073741824 Jul 05 05:21:34 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:35 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a 1073741824" returned: 0 in 1.236s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:35 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:21:35 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:36 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 1.046s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50650427-d6cd-4f58-9ad6-33ea0f75aa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ca0d4a-1179-4555-a207-4dae272c32e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Volume volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a (b604bd59-cb9e-44bd-b699-553e50b4cd7a): created successfully Jul 05 05:21:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ca0d4a-1179-4555-a207-4dae272c32e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Flow 'volume_create_manager' (8cd063ee-ec1b-40ca-b997-4b055cc4c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fc9d3207-5b02-4477-82c8-ad7b256a7de5 tempest-VolumesActionsTest-833525332 None] Created volume successfully. Jul 05 05:21:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-1296e6d5-0b5a-427c-bf6e-189afa5c96a4 req-f597df4f-9944-4276-8ac3-9f292472da5c tempest-TestStampPattern-536924063 None] Terminate volume connection completed successfully. Jul 05 05:21:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-1296e6d5-0b5a-427c-bf6e-189afa5c96a4 req-f597df4f-9944-4276-8ac3-9f292472da5c tempest-TestStampPattern-536924063 None] Deleting attachment 4272ee6d-eeb0-4070-9101-596324649273. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (f1631ab6-097c-487e-b1d6-33191a0d2b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20584691-7451-4eca-a860-bbb98670d67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20584691-7451-4eca-a860-bbb98670d67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-146730815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3baf3d8-685d-4887-ac2f-1b3dc311d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:42Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c087ce-5800-4b2e-8c66-3f0ef67be1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c087ce-5800-4b2e-8c66-3f0ef67be1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9608d5-4c9d-469a-b6c0-21b8362d712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9608d5-4c9d-469a-b6c0-21b8362d712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3baf3d8-685d-4887-ac2f-1b3dc311d505', 'volume_name': 'volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf212a6-16bd-4f9a-a2ec-ebc816425dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf212a6-16bd-4f9a-a2ec-ebc816425dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab11c96-5ec4-4ed8-9fb3-045408bb46e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Volume c3baf3d8-685d-4887-ac2f-1b3dc311d505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505', 'volume_size': 1} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-146730815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3baf3d8-685d-4887-ac2f-1b3dc311d505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:42Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Creating volume c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:42 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:42 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 1073741824 Jul 05 05:21:42 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:43 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 1073741824" returned: 0 in 1.094s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:43 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 Jul 05 05:21:43 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:44 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505" returned: 0 in 0.884s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab11c96-5ec4-4ed8-9fb3-045408bb46e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df554512-2130-4dd6-b4b4-ad70dd69999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:44 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Volume volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 (c3baf3d8-685d-4887-ac2f-1b3dc311d505): created successfully Jul 05 05:21:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df554512-2130-4dd6-b4b4-ad70dd69999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (f1631ab6-097c-487e-b1d6-33191a0d2b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a1587d09-d7fe-4d95-9253-2d10152470bf tempest-VolumesSnapshotTestJSON-1113350108 None] Created volume successfully. Jul 05 05:21:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Creating offline snapshot 7ea47174-91a7-4060-bf5f-21dc0288922f of volume c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:21:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae7c1b7-18d5-4229-8ae0-1e82764f5730]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:45 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 Jul 05 05:21:45 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:46 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505" returned: 0 in 1.018s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:46 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f 1G Jul 05 05:21:46 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:47 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f 1G" returned: 0 in 0.992s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:47 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f Jul 05 05:21:47 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:48 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f" returned: 0 in 1.001s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:48 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f is being set with open permissions: ugo+rw Jul 05 05:21:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:48 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f Jul 05 05:21:48 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-499d22a3-60e9-4905-ac3e-39a40b7f8902-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Lock "cinder-499d22a3-60e9-4905-ac3e-39a40b7f8902-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-quobyte-499d22a3-60e9-4905-ac3e-39a40b7f8902" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-499d22a3-60e9-4905-ac3e-39a40b7f8902" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4375209-214d-4cf2-a6c2-c29b82a3fda5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:49 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 Jul 05 05:21:49 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:49 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f" returned: 0 in 1.006s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:49 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.info Jul 05 05:21:49 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:50 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902" returned: 0 in 1.144s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:50 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902 Jul 05 05:21:50 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:50 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.info" returned: 0 in 1.046s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:50 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.info is being set with open permissions: ugo+rw Jul 05 05:21:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:50 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.info Jul 05 05:21:50 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:51 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-499d22a3-60e9-4905-ac3e-39a40b7f8902" returned: 0 in 0.846s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-499d22a3-60e9-4905-ac3e-39a40b7f8902" released by "delete_volume" :: held 2.040s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Created reservations ['3e3238dd-964b-424e-b42d-e07d73afdef6', 'dcccae4a-027b-429d-8da4-14a8f39f3044', 'a25aaf38-1347-46d4-9a59-25557b6d9826', 'cba9f274-dc41-4d36-a53b-f8028068ffe2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:51 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.info" returned: 0 in 0.827s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:51 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:21:51 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1384318d-c2fe-46c8-b60e-53339ecf784f tempest-VolumesSnapshotTestJSON-1113350108 None] Create snapshot completed successfully Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-7ea47174-91a7-4060-bf5f-21dc0288922f-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-7ea47174-91a7-4060-bf5f-21dc0288922f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-c3baf3d8-685d-4887-ac2f-1b3dc311d505" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-c3baf3d8-685d-4887-ac2f-1b3dc311d505" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-7ea47174-91a7-4060-bf5f-21dc0288922f" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-7ea47174-91a7-4060-bf5f-21dc0288922f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Deleting offline snapshot 7ea47174-91a7-4060-bf5f-21dc0288922f of volume c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] snapshot_file for this snap is: volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[21849e31-908d-4d67-bd61-4b7c782ceea8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:52 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.756s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:21:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Deleted volume successfully. Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d6545000-2245-47fc-b9be-8dda78202e47 tempest-TestStampPattern-536924063 None] Lock "cinder-499d22a3-60e9-4905-ac3e-39a40b7f8902-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:52 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f Jul 05 05:21:52 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-d0495d41-e62b-4bdb-9eaa-17f893b7efb6-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Lock "cinder-d0495d41-e62b-4bdb-9eaa-17f893b7efb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-quobyte-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-quobyte-d0495d41-e62b-4bdb-9eaa-17f893b7efb6" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-d0495d41-e62b-4bdb-9eaa-17f893b7efb6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Deleting offline snapshot d0495d41-e62b-4bdb-9eaa-17f893b7efb6 of volume b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] snapshot_file for this snap is: volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fa0e47-0489-41b9-a39a-5da26283abcc]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:53 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 Jul 05 05:21:53 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:53 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f" returned: 0 in 1.114s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[816f13fb-4798-416f-b958-7ca7ca2569b4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Flow 'volume_create_manager' (1a52f93b-5039-4d68-87f1-4c7f0c6bea7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7da7ef-5a00-4d2b-a6e1-195d7d95c77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab7da7ef-5a00-4d2b-a6e1-195d7d95c77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1928894484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d866d-0277-4a49-8351-b77527632e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a4d1b5b5244a2b960799c39936d265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:53Z,use_quota=True,user_id='4ec1817ab0664b41b0fd8ba8a781ac97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96eaed2-4a56-48ec-9ce6-7d82d7b70047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96eaed2-4a56-48ec-9ce6-7d82d7b70047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5221b5-0fc4-4f30-b573-7421d8a0bea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5221b5-0fc4-4f30-b573-7421d8a0bea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34d866d-0277-4a49-8351-b77527632e9f', 'volume_name': 'volume-d34d866d-0277-4a49-8351-b77527632e9f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b311f02-2d00-42f8-ac56-729c537f4e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b311f02-2d00-42f8-ac56-729c537f4e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edc3094-d441-45ad-9524-1b1033b1df78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:53 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Volume d34d866d-0277-4a49-8351-b77527632e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34d866d-0277-4a49-8351-b77527632e9f', 'volume_size': 1} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1928894484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d866d-0277-4a49-8351-b77527632e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a4d1b5b5244a2b960799c39936d265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:53Z,use_quota=True,user_id='4ec1817ab0664b41b0fd8ba8a781ac97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Creating volume d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:21:53 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 Jul 05 05:21:53 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:21:53 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:21:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:53 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f 1073741824 Jul 05 05:21:53 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:54 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6" returned: 0 in 1.099s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:21:54 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ee36a3-7b7a-4177-b583-981582ba3945]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:54 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:21:54 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:54 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505" returned: 0 in 1.223s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:54 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f Jul 05 05:21:54 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:54 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f 1073741824" returned: 0 in 1.441s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:55 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f Jul 05 05:21:55 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:55 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 1.104s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:55 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 Jul 05 05:21:55 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:55 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f" returned: 0 in 1.005s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:55 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f Jul 05 05:21:55 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:55 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f" returned: 0 in 0.907s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9edc3094-d441-45ad-9524-1b1033b1df78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34d866d-0277-4a49-8351-b77527632e9f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edf874c-f376-4c93-9195-051493eeb2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:55 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Volume volume-d34d866d-0277-4a49-8351-b77527632e9f (d34d866d-0277-4a49-8351-b77527632e9f): created successfully Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edf874c-f376-4c93-9195-051493eeb2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:55 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Flow 'volume_create_manager' (1a52f93b-5039-4d68-87f1-4c7f0c6bea7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:55 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-be12ee0c-afa5-4bd9-b71d-34dbce893d0c tempest-VolumesDeleteCascade-199973598 None] Created volume successfully. Jul 05 05:21:56 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6" returned: 0 in 0.912s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:56 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6 Jul 05 05:21:56 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:56 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505.7ea47174-91a7-4060-bf5f-21dc0288922f" returned: 0 in 0.796s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-7ea47174-91a7-4060-bf5f-21dc0288922f" released by "_delete_snapshot" :: held 4.319s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-c3baf3d8-685d-4887-ac2f-1b3dc311d505" released by "delete_snapshot" :: held 4.350s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['6023a582-cb87-4614-a400-43b75cb58d66', '3982c11f-8856-4841-83fe-b432ad582e5c', 'e1b45fa6-566e-4f93-9ab6-441016d41638', 'fe9a6033-daf5-4779-8a25-c91f0a8bd29d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Delete snapshot completed successfully. Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4b3ac588-b356-48ef-b875-d92ca8e5c257 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-7ea47174-91a7-4060-bf5f-21dc0288922f-delete_snapshot" released by "delete_snapshot" :: held 4.623s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Creating offline snapshot 086bbe07-808a-4562-9037-a35ecf41d375 of volume d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0eb7cb-83af-4a77-85a3-3e9cce0c3837]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:57 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee.d0495d41-e62b-4bdb-9eaa-17f893b7efb6" returned: 0 in 0.851s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-d0495d41-e62b-4bdb-9eaa-17f893b7efb6" released by "_delete_snapshot" :: held 4.125s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" released by "delete_snapshot" :: held 4.165s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:57 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f Jul 05 05:21:57 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Created reservations ['a508a00c-2740-47d1-b8b7-935bd653ead7', '0b4f97e7-7fef-4f53-9a54-29a27f39eda1', '6e295b97-e83d-42d1-9445-bebda7029297', '3792b077-1b01-4cda-8070-11ed37b7e319'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:21:57 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Delete snapshot completed successfully. Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed567632-6c2c-4140-9a30-3257d22def81 tempest-TestStampPattern-536924063 None] Lock "cinder-d0495d41-e62b-4bdb-9eaa-17f893b7efb6-delete_snapshot" released by "delete_snapshot" :: held 4.322s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:57 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f" returned: 0 in 0.957s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:58 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 1G Jul 05 05:21:58 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (979a5604-4713-4ddb-83f3-da0a9880a285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62efaf02-a8b7-4ff5-9049-8e9e0cd841cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62efaf02-a8b7-4ff5-9049-8e9e0cd841cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272184476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb86965b-75c2-4c8f-ab1c-cb40c3a129ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:58Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7596588f-1aa3-453d-8911-57d157358e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7596588f-1aa3-453d-8911-57d157358e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ec2590-8e4f-4b6a-a4e6-dbe5303b07b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ec2590-8e4f-4b6a-a4e6-dbe5303b07b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb86965b-75c2-4c8f-ab1c-cb40c3a129ae', 'volume_name': 'volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87b5a7a-5770-43ae-af4b-716c52137458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87b5a7a-5770-43ae-af4b-716c52137458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc10e008-82f6-4bfb-bd4c-4a20723167bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:21:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume fb86965b-75c2-4c8f-ab1c-cb40c3a129ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae', 'volume_size': 1} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b4837e66-be06-434a-8237-2c4b365adf3e tempest-VolumesActionsTest-833525332 None] Acquiring lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a" by "attach_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b4837e66-be06-434a-8237-2c4b365adf3e tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a" acquired by "attach_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b4837e66-be06-434a-8237-2c4b365adf3e tempest-VolumesActionsTest-833525332 None] Attaching volume b604bd59-cb9e-44bd-b699-553e50b4cd7a to instance bb859230-33b7-45f1-91bc-5788d5e2b554 at mountpoint /dev/vdb on host None. Jul 05 05:21:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b4837e66-be06-434a-8237-2c4b365adf3e tempest-VolumesActionsTest-833525332 None] Attach volume completed successfully. Jul 05 05:21:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b4837e66-be06-434a-8237-2c4b365adf3e tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a" released by "attach_volume" :: held 0.160s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:21:59 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 05 05:21:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 1G" returned: 0 in 1.246s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:21:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:21:59 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 Jul 05 05:21:59 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:21:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c6e41cfd-b1ab-4035-8b7c-51fc876585d3 tempest-VolumesActionsTest-833525332 None] Acquiring lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-detach_volume" by "detach_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:21:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c6e41cfd-b1ab-4035-8b7c-51fc876585d3 tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:21:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c6e41cfd-b1ab-4035-8b7c-51fc876585d3 tempest-VolumesActionsTest-833525332 None] Detaching volume b604bd59-cb9e-44bd-b699-553e50b4cd7a from instance bb859230-33b7-45f1-91bc-5788d5e2b554. Jul 05 05:21:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c6e41cfd-b1ab-4035-8b7c-51fc876585d3 tempest-VolumesActionsTest-833525332 None] Detach volume completed successfully. Jul 05 05:21:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c6e41cfd-b1ab-4035-8b7c-51fc876585d3 tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:00 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375" returned: 0 in 1.079s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:00 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 is being set with open permissions: ugo+rw Jul 05 05:22:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:00 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 Jul 05 05:22:00 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:01 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375" returned: 0 in 0.684s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:01 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.info Jul 05 05:22:01 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:01 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.info" returned: 0 in 0.843s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:01 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.info is being set with open permissions: ugo+rw Jul 05 05:22:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:01 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.info Jul 05 05:22:01 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:02 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.info" returned: 0 in 1.072s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.791s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272184476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb86965b-75c2-4c8f-ab1c-cb40c3a129ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:21:58Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Creating volume fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:22:03 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:03 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae 1073741824 Jul 05 05:22:03 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-02b33f45-5aa3-4b2d-a804-2efaa539ecd1 tempest-VolumesDeleteCascade-199973598 None] Create snapshot completed successfully Jul 05 05:22:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:04 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae 1073741824" returned: 0 in 1.009s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:04 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae Jul 05 05:22:04 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:04 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" returned: 0 in 0.694s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.162s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc10e008-82f6-4bfb-bd4c-4a20723167bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bfdf5e-c2ac-4c2a-a18c-30634cbef708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Creating offline snapshot fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 of volume d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9256c88-b661-47dc-8dde-c0370ad498b3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:04 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae (fb86965b-75c2-4c8f-ab1c-cb40c3a129ae): created successfully Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9bfdf5e-c2ac-4c2a-a18c-30634cbef708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (979a5604-4713-4ddb-83f3-da0a9880a285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-790502a4-4c9d-49be-ab7b-93557cf970a1 tempest-VolumesSnapshotTestJSON-1113350108 None] Created volume successfully. Jul 05 05:22:04 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 Jul 05 05:22:04 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:05 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375" returned: 0 in 0.779s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34d866d-0277-4a49-8351-b77527632e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:22:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:05 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 1G Jul 05 05:22:05 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:06 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 1G" returned: 0 in 0.874s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:06 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 Jul 05 05:22:06 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:07 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" returned: 0 in 0.712s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:07 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 is being set with open permissions: ugo+rw Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:07 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 Jul 05 05:22:07 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-b1bb5c89-3fa7-4ac6-a25d-53919912eaee-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Lock "cinder-b1bb5c89-3fa7-4ac6-a25d-53919912eaee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Acquiring lock "cinder-quobyte-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e949903a-771b-4111-ba76-0357c5b55a82]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:07 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:22:07 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:07 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" returned: 0 in 0.712s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.207s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.057s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Creating offline snapshot 372c42b7-5af7-4dcd-b65a-0004d15b8e9b of volume fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:22:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-00ae5d8d-39c9-42c4-b413-a668079e8054 tempest-VolumesDeleteCascade-199973598 None] Create snapshot completed successfully Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1042263-de97-4a48-af0d-86669ede9b47]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:08 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae Jul 05 05:22:08 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:08 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 0.804s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:08 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee Jul 05 05:22:08 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:08 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" returned: 0 in 0.847s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-d34d866d-0277-4a49-8351-b77527632e9f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:08 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b 1G Jul 05 05:22:08 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-d34d866d-0277-4a49-8351-b77527632e9f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Performing cascade delete. {{(pid=86688) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 05:22:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-086bbe07-808a-4562-9037-a35ecf41d375-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:08 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" returned: 0 in 0.748s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-086bbe07-808a-4562-9037-a35ecf41d375-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Lock "cinder-quobyte-b1bb5c89-3fa7-4ac6-a25d-53919912eaee" released by "delete_volume" :: held 1.635s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-086bbe07-808a-4562-9037-a35ecf41d375" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-086bbe07-808a-4562-9037-a35ecf41d375" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Deleting offline snapshot 086bbe07-808a-4562-9037-a35ecf41d375 of volume d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] snapshot_file for this snap is: volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c20170e-7f4d-42e8-acfa-dd94a53ccf21]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Created reservations ['5bedc816-86b3-4c52-85fc-c81c94abb206', '3551a788-a6eb-47c7-bef0-4285aacddc94', '88cf0217-9fe9-4af1-97cb-736978b234e5', '4b5c356b-e04d-42b7-8aee-c40c007cdac4'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:09 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 Jul 05 05:22:09 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:09 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:22:09 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:09 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b 1G" returned: 0 in 0.914s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:09 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b Jul 05 05:22:09 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:10 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.892s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:22:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Deleted volume successfully. Jul 05 05:22:10 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375" returned: 0 in 1.055s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34d866d-0277-4a49-8351-b77527632e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b190ce-411a-40fa-b146-85b6f7a58c43]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-193492cb-29df-4867-8caa-f69cebbe6b03 tempest-TestStampPattern-536924063 None] Lock "cinder-b1bb5c89-3fa7-4ac6-a25d-53919912eaee-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:10 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f Jul 05 05:22:10 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:10 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b" returned: 0 in 0.919s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:10 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b is being set with open permissions: ugo+rw Jul 05 05:22:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:10 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b Jul 05 05:22:10 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:11 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f" returned: 0 in 0.836s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e8332-dc67-4187-84e4-7b4c16ff5d04]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:11 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 Jul 05 05:22:11 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:11 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b" returned: 0 in 0.721s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:11 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.info Jul 05 05:22:11 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:11 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" returned: 0 in 0.844s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34d866d-0277-4a49-8351-b77527632e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56d85fc-8e59-4d22-90d1-bd218e94c96b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:12 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 Jul 05 05:22:12 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:12 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.info" returned: 0 in 0.755s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:12 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.info is being set with open permissions: ugo+rw Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:12 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.info Jul 05 05:22:12 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:12 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375" returned: 0 in 0.883s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34d866d-0277-4a49-8351-b77527632e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df8efd8-8f42-4448-9abc-6e1a2e7170a9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:12 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.info" returned: 0 in 0.728s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-668a15e0-fca5-4b79-8d23-a2efe45f6364 tempest-VolumesSnapshotTestJSON-1113350108 None] Create snapshot completed successfully Jul 05 05:22:13 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f Jul 05 05:22:13 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:13 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f" returned: 0 in 1.090s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:14 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 Jul 05 05:22:14 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (e2ced56b-406d-4410-8bff-5d4e43c66095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ae1be6-d110-478b-9983-df2b1a07d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ae1be6-d110-478b-9983-df2b1a07d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1076961167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=156a737b-1ad2-442f-b1e1-1ddd6110ea3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=372c42b7-5af7-4dcd-b65a-0004d15b8e9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:14Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990e1f18-1967-4d66-a447-27826b093c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990e1f18-1967-4d66-a447-27826b093c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71407ae-ec3f-4557-905f-ec7ea3405d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71407ae-ec3f-4557-905f-ec7ea3405d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '156a737b-1ad2-442f-b1e1-1ddd6110ea3e', 'volume_name': 'volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e', 'volume_size': 2, 'snapshot_id': '372c42b7-5af7-4dcd-b65a-0004d15b8e9b'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e48efc1-95b5-4126-955a-8c6883594041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e48efc1-95b5-4126-955a-8c6883594041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066a1a9d-3820-47f9-a51a-2b81c783067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:14 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Volume 156a737b-1ad2-442f-b1e1-1ddd6110ea3e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e', 'volume_size': 2, 'snapshot_id': '372c42b7-5af7-4dcd-b65a-0004d15b8e9b'} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-372c42b7-5af7-4dcd-b65a-0004d15b8e9b-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-372c42b7-5af7-4dcd-b65a-0004d15b8e9b-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Creating volume 156a737b-1ad2-442f-b1e1-1ddd6110ea3e from snapshot 372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] snapshot: 372c42b7-5af7-4dcd-b65a-0004d15b8e9b, volume: 156a737b-1ad2-442f-b1e1-1ddd6110ea3e, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a5c018-57c5-4e2b-9785-1a4b11c7c8a8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:14 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b Jul 05 05:22:14 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:15 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375" returned: 0 in 1.362s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:15 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375 Jul 05 05:22:15 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:15 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b" returned: 0 in 1.187s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b00960-73a1-4081-8098-07a04bc48ed8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:16 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae Jul 05 05:22:16 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:16 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.086bbe07-808a-4562-9037-a35ecf41d375" returned: 0 in 0.875s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 -F qcow2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:16 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 -F qcow2 Jul 05 05:22:16 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:16 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" returned: 0 in 1.201s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:16 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:22:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:17 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e Jul 05 05:22:17 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:17 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34d866d-0277-4a49-8351-b77527632e9f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 -F qcow2" returned: 0 in 0.858s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-086bbe07-808a-4562-9037-a35ecf41d375" released by "_delete_snapshot" :: held 8.058s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" released by "delete_snapshot" :: held 8.088s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=88,cinder:SELECT=91,cinder:INSERT=24,cinder:DELETE=9 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Created reservations ['9980a434-006b-4991-9770-4c125a1d1f53', '9e8f5836-d731-47f1-88ca-736a385cb5a3', '99ca4058-1899-4133-8938-e19debd4b800', 'bf732a58-1656-4daf-9db2-1c6c93542b5f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Delete snapshot completed successfully. Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-086bbe07-808a-4562-9037-a35ecf41d375-delete_snapshot" released by "delete_snapshot" :: held 8.413s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-fe74a4a5-114d-4ce8-8921-9b81e3d47cd5-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-fe74a4a5-114d-4ce8-8921-9b81e3d47cd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Deleting offline snapshot fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 of volume d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] snapshot_file for this snap is: volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964e0aa-8f8d-479c-8e21-be20776f658d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:17 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 Jul 05 05:22:17 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:19 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" returned: 0 in 1.534s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34d866d-0277-4a49-8351-b77527632e9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:22:19 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[112e450d-dc4c-497a-9f20-37514c1a3360]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:19 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f Jul 05 05:22:19 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:21 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f" returned: 0 in 1.919s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:21 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 Jul 05 05:22:21 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:23 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=92,cinder:INSERT=20,cinder:UPDATE=86,cinder:DELETE=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:22:24 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" returned: 0 in 2.983s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:24 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5 Jul 05 05:22:24 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:24 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" returned: 0 in 7.360s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:24 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3079223b-e645-4755-b4b0-6dbb0dc9c820]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:24 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae Jul 05 05:22:24 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:25 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f.fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" returned: 0 in 1.178s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-fe74a4a5-114d-4ce8-8921-9b81e3d47cd5" released by "_delete_snapshot" :: held 7.776s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" released by "delete_snapshot" :: held 7.799s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Created reservations ['7b78cf39-f42a-40a3-b9fa-4c6ea7954766', 'aada1250-60f9-48a5-9516-20990aee329a', '2744afe7-ea6a-4f87-9759-77c17c7ed197', '89ccc285-cd0c-4fb3-abe2-ed3026711ca0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:25 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Delete snapshot completed successfully. Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-fe74a4a5-114d-4ce8-8921-9b81e3d47cd5-delete_snapshot" released by "delete_snapshot" :: held 8.015s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Snapshots deleted, issuing volume delete {{(pid=86688) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ceb1d1-120b-4d18-995f-e3a8f66dc8d8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:25 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f Jul 05 05:22:25 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:25 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" returned: 0 in 1.613s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:22:25 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Converted 1024.00 MB image at 139.11 MB/s Jul 05 05:22:25 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e is being set with open permissions: ugo+rw Jul 05 05:22:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:26 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e Jul 05 05:22:26 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:26 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f" returned: 0 in 1.291s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:26 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f Jul 05 05:22:26 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:27 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" returned: 0 in 1.148s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" released by "_copy_volume_from_snapshot" :: held 12.756s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-372c42b7-5af7-4dcd-b65a-0004d15b8e9b-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" released by "_create_volume_from_snapshot" :: held 12.838s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.876s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066a1a9d-3820-47f9-a51a-2b81c783067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e', 'volume_size': 2, 'snapshot_id': '372c42b7-5af7-4dcd-b65a-0004d15b8e9b'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642cfabf-12c3-4f65-b2e7-f71f217959a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:27 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Volume volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e (156a737b-1ad2-442f-b1e1-1ddd6110ea3e): created successfully Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642cfabf-12c3-4f65-b2e7-f71f217959a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (e2ced56b-406d-4410-8bff-5d4e43c66095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:27 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c5123fe7-f6cc-47d0-a9e2-5992ded46bfc tempest-VolumesSnapshotTestJSON-1113350108 None] Created volume successfully. Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30063ed9-a976-4021-902b-3252305476e9 tempest-VolumesActionsTest-833525332 None] Acquiring lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a" by "attach_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30063ed9-a976-4021-902b-3252305476e9 tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a" acquired by "attach_volume" :: waited 0.046s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:27 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d34d866d-0277-4a49-8351-b77527632e9f" returned: 0 in 1.063s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d34d866d-0277-4a49-8351-b77527632e9f" released by "delete_volume" :: held 2.507s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-30063ed9-a976-4021-902b-3252305476e9 tempest-VolumesActionsTest-833525332 None] Attaching volume b604bd59-cb9e-44bd-b699-553e50b4cd7a to instance 9429db7c-9e41-4a97-b150-d0b200d43007 at mountpoint /dev/vdb on host None. Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-156a737b-1ad2-442f-b1e1-1ddd6110ea3e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Created reservations ['9b4dffc2-ccab-4238-960a-3f810701155b', '18b48934-6059-4669-a9bf-c54ad8c348d6', '41257e4e-af94-46c8-88c7-1eaa19ff39c2', '09eb1ab6-bb11-47bc-9248-76e157fbaa66'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-30063ed9-a976-4021-902b-3252305476e9 tempest-VolumesActionsTest-833525332 None] Attach volume completed successfully. Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-156a737b-1ad2-442f-b1e1-1ddd6110ea3e-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30063ed9-a976-4021-902b-3252305476e9 tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a" released by "attach_volume" :: held 0.245s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" acquired by "delete_volume" :: waited 0.063s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:28 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:22:28 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f365b019-0a73-47fe-a138-f06baa88ce3a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:28 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e Jul 05 05:22:28 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff97a775-07cc-41bc-a7f4-0a5cdb6b0b7c tempest-VolumesActionsTest-833525332 None] Acquiring lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-detach_volume" by "detach_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff97a775-07cc-41bc-a7f4-0a5cdb6b0b7c tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ff97a775-07cc-41bc-a7f4-0a5cdb6b0b7c tempest-VolumesActionsTest-833525332 None] Detaching volume b604bd59-cb9e-44bd-b699-553e50b4cd7a from instance 9429db7c-9e41-4a97-b150-d0b200d43007. Jul 05 05:22:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ff97a775-07cc-41bc-a7f4-0a5cdb6b0b7c tempest-VolumesActionsTest-833525332 None] Detach volume completed successfully. Jul 05 05:22:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ff97a775-07cc-41bc-a7f4-0a5cdb6b0b7c tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:29 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.013s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:22:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Deleted volume successfully. Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-27e074fb-0e89-4dae-84b1-3cc8af0ee13f tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-d34d866d-0277-4a49-8351-b77527632e9f-delete_volume" released by "delete_volume" :: held 20.435s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:29 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" returned: 0 in 1.463s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:29 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e Jul 05 05:22:29 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Flow 'volume_create_manager' (99db3b58-d71e-4d6e-aaf3-ebacf41fbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c0ec6d-8057-468c-a4ea-22cf151340a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c0ec6d-8057-468c-a4ea-22cf151340a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-604513133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a4d1b5b5244a2b960799c39936d265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:30Z,use_quota=True,user_id='4ec1817ab0664b41b0fd8ba8a781ac97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9f9d1b-2acf-47da-b53e-16ba7466ac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9f9d1b-2acf-47da-b53e-16ba7466ac06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a1bcec-01b2-411f-8f26-b8c358a764e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a1bcec-01b2-411f-8f26-b8c358a764e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951', 'volume_name': 'volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc09c3-fd5e-4c06-8d80-38bc2ca19df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc09c3-fd5e-4c06-8d80-38bc2ca19df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872feddc-b0f8-475d-a3fd-49ffc8f0115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:29 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Volume 5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951', 'volume_size': 1} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-604513133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a4d1b5b5244a2b960799c39936d265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:30Z,use_quota=True,user_id='4ec1817ab0664b41b0fd8ba8a781ac97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Creating volume 5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:22:29 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:30 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 1073741824 Jul 05 05:22:30 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:30 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:22:30 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:30 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" returned: 0 in 0.951s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-156a737b-1ad2-442f-b1e1-1ddd6110ea3e" released by "delete_volume" :: held 2.483s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['05849f4c-b603-45c1-88c7-30d267fa2f44', '43052322-1869-49e0-8e23-6be114e87178', '4643158d-1a9d-4b4c-ab9b-5e70b7805f60', 'cc070457-d6fb-43fb-b9c4-15962363ae23'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:30 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:22:30 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:31 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 1073741824" returned: 0 in 1.077s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:31 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 Jul 05 05:22:31 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:31 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.066s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-372c42b7-5af7-4dcd-b65a-0004d15b8e9b-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-372c42b7-5af7-4dcd-b65a-0004d15b8e9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-372c42b7-5af7-4dcd-b65a-0004d15b8e9b" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-372c42b7-5af7-4dcd-b65a-0004d15b8e9b" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Deleting offline snapshot 372c42b7-5af7-4dcd-b65a-0004d15b8e9b of volume fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] snapshot_file for this snap is: volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c33dd-1825-4bf1-80dd-ed3cc68f4067]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:32 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" returned: 0 in 1.091s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:32 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.342s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872feddc-b0f8-475d-a3fd-49ffc8f0115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df127933-6d6d-49df-9946-09acfe70f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Deleted volume successfully. Jul 05 05:22:32 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Volume volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 (5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951): created successfully Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df127933-6d6d-49df-9946-09acfe70f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Flow 'volume_create_manager' (99db3b58-d71e-4d6e-aaf3-ebacf41fbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:32 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b Jul 05 05:22:32 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95341602-b4c7-4ff6-bda7-7eee29626adb tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-156a737b-1ad2-442f-b1e1-1ddd6110ea3e-delete_volume" released by "delete_volume" :: held 4.312s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-95801bb5-d873-4793-8f9c-72e931427422 tempest-VolumesDeleteCascade-199973598 None] Created volume successfully. Jul 05 05:22:33 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b" returned: 0 in 1.230s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[737bb68d-3df3-4753-8b1b-fe8243f2509a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:33 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae Jul 05 05:22:33 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Creating offline snapshot 3e267ba7-01b9-4e51-84cd-7c1605680a83 of volume 5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a43e10-14bd-42fe-a9b8-89b292e6e324]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:33 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 Jul 05 05:22:33 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:34 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" returned: 0 in 0.911s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:34 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b Jul 05 05:22:34 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:34 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" returned: 0 in 0.835s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:34 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 1G Jul 05 05:22:34 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Flow 'volume_create_manager' (b53304d3-9cd3-4c9a-b95d-588210b155f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f99550-0e19-4933-92fc-ecbef43ffb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f99550-0e19-4933-92fc-ecbef43ffb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adef2653-811b-439f-8ecf-3798c3cb2ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de31060ade9e42fd8b5b62db9713db85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:35Z,use_quota=True,user_id='6b1c9f1a40af47eaac012e8f3416ef64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9d1ded5-9afb-4a2a-8dfc-591cdb65f037),volume_type_id=f9d1ded5-9afb-4a2a-8dfc-591cdb65f037)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98819add-f815-40a5-910e-4d123dc60e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98819add-f815-40a5-910e-4d123dc60e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e97362e-c85c-43e8-9fe3-538d0886224d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:34 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:22:35 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e97362e-c85c-43e8-9fe3-538d0886224d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adef2653-811b-439f-8ecf-3798c3cb2ba4', 'volume_name': 'volume-adef2653-811b-439f-8ecf-3798c3cb2ba4', 'volume_size': 1, 'image_id': 'f9d62e33-3be4-4f61-802a-e36d8882b407', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d62e33-3be4-4f61-802a-e36d8882b407', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b399163fd2de0f219d91791d946dcd35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de31060ade9e42fd8b5b62db9713db85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c067e56f27da03107965c036a85be2f3cbbeb3dbdf773cdd25cc6d46449255c7f6b4293fc80f0570c14076cd35b5a8577ff371d1daefeceb56d2caae81818b7', 'id': 'f9d62e33-3be4-4f61-802a-e36d8882b407', 'created_at': datetime.datetime(2026, 7, 5, 3, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 22, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d62e33-3be4-4f61-802a-e36d8882b407/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f468e3-e8ea-421e-983e-78681571e249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75f468e3-e8ea-421e-983e-78681571e249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72592785-fc62-43bf-9d13-9dc82a29a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Volume adef2653-811b-439f-8ecf-3798c3cb2ba4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adef2653-811b-439f-8ecf-3798c3cb2ba4', 'volume_size': 1, 'image_id': 'f9d62e33-3be4-4f61-802a-e36d8882b407', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d62e33-3be4-4f61-802a-e36d8882b407', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b399163fd2de0f219d91791d946dcd35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de31060ade9e42fd8b5b62db9713db85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c067e56f27da03107965c036a85be2f3cbbeb3dbdf773cdd25cc6d46449255c7f6b4293fc80f0570c14076cd35b5a8577ff371d1daefeceb56d2caae81818b7', 'id': 'f9d62e33-3be4-4f61-802a-e36d8882b407', 'created_at': datetime.datetime(2026, 7, 5, 3, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 22, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d62e33-3be4-4f61-802a-e36d8882b407/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Trying to clone adef2653-811b-439f-8ecf-3798c3cb2ba4 from image f9d62e33-3be4-4f61-802a-e36d8882b407 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9d62e33-3be4-4f61-802a-e36d8882b407', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b" returned: 0 in 0.861s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:35 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b Jul 05 05:22:35 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:22:35 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Image download 0.00 MB at 0.00 MB/s Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9236edd3-5524-4618-bb5d-0a0671d98d89]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:35 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD Jul 05 05:22:35 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:35 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 1G" returned: 0 in 0.939s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:35 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 Jul 05 05:22:35 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:35 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae.372c42b7-5af7-4dcd-b65a-0004d15b8e9b" returned: 0 in 0.741s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-372c42b7-5af7-4dcd-b65a-0004d15b8e9b" released by "_delete_snapshot" :: held 3.921s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" released by "delete_snapshot" :: held 3.975s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:35 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['9f1ea13d-4dff-49f4-9a89-ce2d04a0ae05', '86fa6b2b-7dbc-4416-aefe-540c797f1f67', '152d7bcf-d330-45b6-afd1-b01a84c27af7', '4f282985-ff77-4e7f-a016-a789f586e749'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Delete snapshot completed successfully. Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c76ec7d0-69d5-48a1-972d-8c24fac38c1a tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-372c42b7-5af7-4dcd-b65a-0004d15b8e9b-delete_snapshot" released by "delete_snapshot" :: held 4.149s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:36 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD" returned: 0 in 0.811s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:36 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83" returned: 0 in 0.761s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:36 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 is being set with open permissions: ugo+rw Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:36 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD Jul 05 05:22:36 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:36 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 Jul 05 05:22:36 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e48ccb2-02bd-4033-85db-113d3aa198de]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:36 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae Jul 05 05:22:36 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:36 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83" returned: 0 in 0.675s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:36 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD" returned: 1 in 0.840s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:22:36 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Temporary image f9d62e33-3be4-4f61-802a-e36d8882b407 is fetched for user 6b1c9f1a40af47eaac012e8f3416ef64. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:22:36 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.info Jul 05 05:22:36 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb714971-cab2-4f0d-aeea-d2232605579a]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:37 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD Jul 05 05:22:37 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:37 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" returned: 0 in 0.849s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:37 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae Jul 05 05:22:37 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:37 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.info" returned: 0 in 0.706s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:37 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.info is being set with open permissions: ugo+rw Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:37 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.info Jul 05 05:22:37 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:37 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD" returned: 0 in 0.870s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:38 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD Jul 05 05:22:38 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:38 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" returned: 0 in 0.848s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae" released by "delete_volume" :: held 1.795s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['70ac270e-c820-4f3a-b8be-ba7bfd16b97f', '5db84dcd-452c-40a3-a5a3-961c46e4dd25', 'e779997c-e156-4700-acd6-0402c9363637', '14226c6a-349a-45de-83e8-cfbf973a8cab'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:38 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:22:38 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:38 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.info" returned: 0 in 0.836s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.872s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4a7bdb8f-b0dc-418a-9528-13dd4e0d72a1 tempest-VolumesDeleteCascade-199973598 None] Create snapshot completed successfully Jul 05 05:22:38 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD" returned: 1 in 1.029s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adef2653-811b-439f-8ecf-3798c3cb2ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de31060ade9e42fd8b5b62db9713db85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:35Z,use_quota=True,user_id='6b1c9f1a40af47eaac012e8f3416ef64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9d1ded5-9afb-4a2a-8dfc-591cdb65f037),volume_type_id=f9d1ded5-9afb-4a2a-8dfc-591cdb65f037)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Creating volume adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:22:38 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:22:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:38 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 1073741824 Jul 05 05:22:38 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:39 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.805s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (dd63a490-4608-494d-a2ad-4d61a657ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc162aea-a9ee-4743-a874-2deb4505b66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Deleted volume successfully. Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc162aea-a9ee-4743-a874-2deb4505b66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1352565520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9390db-8a76-4d21-8e80-3d1ccbfd51eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:39Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caf096a-b623-4acb-8fcc-fba304f1c891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caf096a-b623-4acb-8fcc-fba304f1c891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bfd3d2-eebf-4610-96f8-8f47bcdca13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bfd3d2-eebf-4610-96f8-8f47bcdca13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9390db-8a76-4d21-8e80-3d1ccbfd51eb', 'volume_name': 'volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad786ed8-1893-405c-a3ea-72458960351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad786ed8-1893-405c-a3ea-72458960351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6562315c-3015-4cbf-ada7-a832f4dd7275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume 8e9390db-8a76-4d21-8e80-3d1ccbfd51eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb', 'volume_size': 1} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63bb8a4d-a13f-4f6c-b13b-f20113c4fa7e tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-fb86965b-75c2-4c8f-ab1c-cb40c3a129ae-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Flow 'volume_create_manager' (4ef625af-53c3-4190-a1f9-cd5f0aa46df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ace86f5-36f6-4e92-968c-73d489ddf97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ace86f5-36f6-4e92-968c-73d489ddf97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-481740570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d393a556-a637-4b02-b6dd-0e0b08aca619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a4d1b5b5244a2b960799c39936d265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e267ba7-01b9-4e51-84cd-7c1605680a83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:40Z,use_quota=True,user_id='4ec1817ab0664b41b0fd8ba8a781ac97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935e7fb-274f-42c9-8590-df98fe73e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935e7fb-274f-42c9-8590-df98fe73e90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7c01b2-872a-440e-87fa-c939ac11c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec7c01b2-872a-440e-87fa-c939ac11c275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd393a556-a637-4b02-b6dd-0e0b08aca619', 'volume_name': 'volume-d393a556-a637-4b02-b6dd-0e0b08aca619', 'volume_size': 1, 'snapshot_id': '3e267ba7-01b9-4e51-84cd-7c1605680a83'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403d371e-7b73-4eca-b34a-c70805b44c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403d371e-7b73-4eca-b34a-c70805b44c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d182699-ddc6-4839-992d-310abc694bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:39 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Volume d393a556-a637-4b02-b6dd-0e0b08aca619: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d393a556-a637-4b02-b6dd-0e0b08aca619', 'volume_size': 1, 'snapshot_id': '3e267ba7-01b9-4e51-84cd-7c1605680a83'} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 1073741824" returned: 0 in 0.982s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:39 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 Jul 05 05:22:39 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:40 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.329s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c81f73-66dc-46ac-9923-9586dbcca5d0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Attempting download of f9d62e33-3be4-4f61-802a-e36d8882b407 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d62e33-3be4-4f61-802a-e36d8882b407', 'metadata': {}}])) to volume adef2653-811b-439f-8ecf-3798c3cb2ba4. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ca09e0-d91e-4117-8879-7326fee75322]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d62e33-3be4-4f61-802a-e36d8882b407_tcdos5sm {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:40 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:22:40 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:40 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d62e33-3be4-4f61-802a-e36d8882b407_tcdos5sm Jul 05 05:22:40 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:41 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.789s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:41 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a55ef-1bd6-4983-9b10-52e8c8bb821d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:41 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9d62e33-3be4-4f61-802a-e36d8882b407_tcdos5sm" returned: 0 in 0.764s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d62e33-3be4-4f61-802a-e36d8882b407_tcdos5sm {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:41 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:22:41 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:41 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d62e33-3be4-4f61-802a-e36d8882b407_tcdos5sm Jul 05 05:22:41 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:42 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d62e33-3be4-4f61-802a-e36d8882b407_tcdos5sm" returned: 1 in 0.725s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9d62e33-3be4-4f61-802a-e36d8882b407_tcdos5sm' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f7a426-3a3b-4bc2-9e9d-f52ceb66955b]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:42 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.783s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.a754228a-5205-456d-8873-7768b8975343fuqs3c9p.img {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:42 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.a754228a-5205-456d-8873-7768b8975343fuqs3c9p.img Jul 05 05:22:42 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:42 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD Jul 05 05:22:42 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:42 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:43 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD Jul 05 05:22:43 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:44 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD" returned: 1 in 1.400s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:22:44 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] f9d62e33-3be4-4f61-802a-e36d8882b407 was raw, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:22:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:44 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 Jul 05 05:22:44 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:45 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4" returned: 0 in 1.423s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:45 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9d62e33-3be4-4f61-802a-e36d8882b407_nl0yu3r2devstack@QuobyteHD, size 0.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:22:45 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 05:22:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:45 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 1G Jul 05 05:22:45 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:47 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 1G" returned: 0 in 1.289s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef3a32-bdf0-4479-b06c-260310a6c6b9]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:47 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.a754228a-5205-456d-8873-7768b8975343fuqs3c9p.img" returned: 0 in 4.991s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876c104-eb28-4cb2-9fad-547161581323]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:47 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 Jul 05 05:22:47 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:47 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:22:47 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:47 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4" returned: 0 in 0.743s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:48 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 Jul 05 05:22:48 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:48 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.944s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.a754228a-5205-456d-8873-7768b8975343fuqs3c9p.img {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:22:48 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Converted 1024.00 MB image at 205.12 MB/s Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] a754228a-5205-456d-8873-7768b8975343 was raw, no need to convert to raw {{(pid=86688) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 05 05:22:48 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4" returned: 1 in 0.749s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Downloaded image f9d62e33-3be4-4f61-802a-e36d8882b407 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9d62e33-3be4-4f61-802a-e36d8882b407', 'metadata': {}}])) to volume adef2653-811b-439f-8ecf-3798c3cb2ba4 successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Temporary image f9d62e33-3be4-4f61-802a-e36d8882b407 for user 6b1c9f1a40af47eaac012e8f3416ef64 is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Marking volume adef2653-811b-439f-8ecf-3798c3cb2ba4 as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Copying metadata from image f9d62e33-3be4-4f61-802a-e36d8882b407 to adef2653-811b-439f-8ecf-3798c3cb2ba4. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Creating volume glance metadata for volume adef2653-811b-439f-8ecf-3798c3cb2ba4 backed by image f9d62e33-3be4-4f61-802a-e36d8882b407 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f9d62e33-3be4-4f61-802a-e36d8882b407', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b399163fd2de0f219d91791d946dcd35', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72592785-fc62-43bf-9d13-9dc82a29a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adef2653-811b-439f-8ecf-3798c3cb2ba4', 'volume_size': 1, 'image_id': 'f9d62e33-3be4-4f61-802a-e36d8882b407', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9d62e33-3be4-4f61-802a-e36d8882b407', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b399163fd2de0f219d91791d946dcd35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'de31060ade9e42fd8b5b62db9713db85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4c067e56f27da03107965c036a85be2f3cbbeb3dbdf773cdd25cc6d46449255c7f6b4293fc80f0570c14076cd35b5a8577ff371d1daefeceb56d2caae81818b7', 'id': 'f9d62e33-3be4-4f61-802a-e36d8882b407', 'created_at': datetime.datetime(2026, 7, 5, 3, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 22, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9d62e33-3be4-4f61-802a-e36d8882b407/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ff5756-b3b7-42f8-94d9-6aa0fe20e387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:48 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Volume volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 (adef2653-811b-439f-8ecf-3798c3cb2ba4): created successfully Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ff5756-b3b7-42f8-94d9-6aa0fe20e387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Flow 'volume_create_manager' (b53304d3-9cd3-4c9a-b95d-588210b155f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5a298cd8-d931-4b0f-87cb-f65078e9b3f6 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Created volume successfully. Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Acquiring lock "cinder-adef2653-811b-439f-8ecf-3798c3cb2ba4-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "cinder-adef2653-811b-439f-8ecf-3798c3cb2ba4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Acquiring lock "cinder-quobyte-adef2653-811b-439f-8ecf-3798c3cb2ba4" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:22:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "cinder-quobyte-adef2653-811b-439f-8ecf-3798c3cb2ba4" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:22:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d09bef-1739-4cff-857d-53981c1244f3]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:22:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:49 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 Jul 05 05:22:49 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:49 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4" returned: 0 in 0.795s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:49 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 Jul 05 05:22:49 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:50 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4" returned: 1 in 0.810s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:22:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:50 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4 Jul 05 05:22:50 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:51 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-adef2653-811b-439f-8ecf-3798c3cb2ba4" returned: 0 in 0.680s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "cinder-quobyte-adef2653-811b-439f-8ecf-3798c3cb2ba4" released by "delete_volume" :: held 2.353s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:51 devstack cinder-volume[86688]: WARNING cinder.quota [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:22:51 devstack cinder-volume[86688]: WARNING cinder.quota [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Created reservations ['20164d36-144c-4b53-b41e-164d9550a55e', 'caca20d5-8497-43b5-bfb6-2676e60e414e', 'e13d7bed-2991-4670-ba9e-374ec49098f6', '025d25a6-6f25-498d-9bbe-9de63760e866'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:22:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:22:51 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:22:51 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:22:52 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 05 05:22:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.689s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:22:52 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:22:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Deleted volume successfully. Jul 05 05:22:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-904b0456-d94a-45f9-88ba-25991cfe1f93 tempest-VolumeAndVolumeTypeFromImageTest-1926000771 None] Lock "cinder-adef2653-811b-439f-8ecf-3798c3cb2ba4-delete_volume" released by "delete_volume" :: held 3.296s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (ba3d1387-9eb7-406b-8e00-cfe1367eba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c586631-ff29-4da2-81d9-f17570b89716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c586631-ff29-4da2-81d9-f17570b89716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355320769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50e2569-9ab8-4a66-b62c-f7845b6dc7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:57Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94085a5-b969-4487-a159-232280f87f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94085a5-b969-4487-a159-232280f87f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617898c0-3772-4675-b762-6238aca016a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617898c0-3772-4675-b762-6238aca016a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50e2569-9ab8-4a66-b62c-f7845b6dc7ce', 'volume_name': 'volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be493c88-2c3d-4bae-b35a-bf89647899ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be493c88-2c3d-4bae-b35a-bf89647899ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f6b269-151f-4ea4-af40-5c2327f43b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:22:57 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume d50e2569-9ab8-4a66-b62c-f7845b6dc7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce', 'volume_size': 1} Jul 05 05:22:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=61,cinder:INSERT=25,cinder:UPDATE=53,cinder:DELETE=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=51,cinder:INSERT=16,cinder:UPDATE=67,cinder:DELETE=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.106s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Uploaded volume to glance image-id: a754228a-5205-456d-8873-7768b8975343. {{(pid=86688) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.390s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1352565520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9390db-8a76-4d21-8e80-3d1ccbfd51eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:39Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Creating volume 8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:07 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:07 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb 1073741824 Jul 05 05:23:07 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c0f89b28-eb7e-4e0f-9f70-9bb024642b80 tempest-VolumesActionsTest-833525332 None] Copy volume to image completed successfully. Jul 05 05:23:08 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb 1073741824" returned: 0 in 0.883s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:08 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb Jul 05 05:23:08 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:09 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" returned: 0 in 0.699s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 29.434s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-3e267ba7-01b9-4e51-84cd-7c1605680a83-d393a556-a637-4b02-b6dd-0e0b08aca619" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6562315c-3015-4cbf-ada7-a832f4dd7275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c6d0d0-8b43-4993-8320-4d06c0741a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-3e267ba7-01b9-4e51-84cd-7c1605680a83-d393a556-a637-4b02-b6dd-0e0b08aca619" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Creating volume d393a556-a637-4b02-b6dd-0e0b08aca619 from snapshot 3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-d393a556-a637-4b02-b6dd-0e0b08aca619" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb (8e9390db-8a76-4d21-8e80-3d1ccbfd51eb): created successfully Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c6d0d0-8b43-4993-8320-4d06c0741a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (dd63a490-4608-494d-a2ad-4d61a657ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d393a556-a637-4b02-b6dd-0e0b08aca619" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] snapshot: 3e267ba7-01b9-4e51-84cd-7c1605680a83, volume: d393a556-a637-4b02-b6dd-0e0b08aca619, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:23:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-011c70bc-b3ba-4daf-a501-6ceda1d1c1b8 tempest-VolumesSnapshotTestJSON-1113350108 None] Created volume successfully. Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbffc18-4af0-4f9d-9973-2750d83d3faa]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:09 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 Jul 05 05:23:09 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:10 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83" returned: 0 in 0.755s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:23:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:23:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:23:10 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b2011a-ce08-46f9-a22d-2e7aa32cf9eb]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:10 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 Jul 05 05:23:10 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:11 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" returned: 0 in 0.780s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:11 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:23:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:11 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 Jul 05 05:23:11 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:15 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619" returned: 0 in 4.374s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee49dbb-2424-4fdf-8bcd-a60585b63332]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:15 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 Jul 05 05:23:15 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:16 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" returned: 0 in 0.901s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:16 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:23:16 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Converted 1024.00 MB image at 234.00 MB/s Jul 05 05:23:16 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 is being set with open permissions: ugo+rw Jul 05 05:23:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:16 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 Jul 05 05:23:16 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:16 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619" returned: 0 in 0.648s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d393a556-a637-4b02-b6dd-0e0b08aca619" released by "_copy_volume_from_snapshot" :: held 7.555s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-3e267ba7-01b9-4e51-84cd-7c1605680a83-d393a556-a637-4b02-b6dd-0e0b08aca619" released by "_create_volume_from_snapshot" :: held 7.599s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.639s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.688s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1355320769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50e2569-9ab8-4a66-b62c-f7845b6dc7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:22:57Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Creating volume d50e2569-9ab8-4a66-b62c-f7845b6dc7ce {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:17 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:17 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce 1073741824 Jul 05 05:23:17 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d182699-ddc6-4839-992d-310abc694bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d393a556-a637-4b02-b6dd-0e0b08aca619', 'volume_size': 1, 'snapshot_id': '3e267ba7-01b9-4e51-84cd-7c1605680a83'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ec0394-76b6-4f2e-89ae-66f90b5bc89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:17 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Volume volume-d393a556-a637-4b02-b6dd-0e0b08aca619 (d393a556-a637-4b02-b6dd-0e0b08aca619): created successfully Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ec0394-76b6-4f2e-89ae-66f90b5bc89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Flow 'volume_create_manager' (4ef625af-53c3-4190-a1f9-cd5f0aa46df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-78e7fdd2-4097-41b3-ac64-4f14a45bb300 tempest-VolumesDeleteCascade-199973598 None] Created volume successfully. Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Performing cascade delete. {{(pid=86688) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-3e267ba7-01b9-4e51-84cd-7c1605680a83-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-3e267ba7-01b9-4e51-84cd-7c1605680a83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-3e267ba7-01b9-4e51-84cd-7c1605680a83" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-3e267ba7-01b9-4e51-84cd-7c1605680a83" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Deleting offline snapshot 3e267ba7-01b9-4e51-84cd-7c1605680a83 of volume 5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] snapshot_file for this snap is: volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[386e049d-ce24-4e2f-b3ce-f63adc042323]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:17 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce 1073741824" returned: 0 in 0.892s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:17 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 Jul 05 05:23:17 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:17 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce Jul 05 05:23:17 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:18 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce" returned: 0 in 0.665s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 9.360s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:18 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f6b269-151f-4ea4-af40-5c2327f43b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcaccd9-10e0-454e-8364-150ee13b63d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8601958-b905-44bb-b565-4d837d18b371]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83" returned: 0 in 0.813s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:23:18 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce (d50e2569-9ab8-4a66-b62c-f7845b6dc7ce): created successfully Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fcaccd9-10e0-454e-8364-150ee13b63d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (ba3d1387-9eb7-406b-8e00-cfe1367eba82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f9f934-b001-458b-860a-637a3760e656]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-69a2c351-cd04-4920-99f3-1c00fda82f90 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created volume successfully. Jul 05 05:23:18 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:23:18 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:18 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 Jul 05 05:23:18 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:19 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:19 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9525c58-c53e-40d7-a2b2-8486d16a77d1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:19 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" returned: 0 in 0.782s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:19 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 Jul 05 05:23:19 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:19 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:23:19 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:20 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.798s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:20 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:20 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img Jul 05 05:23:20 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83" returned: 0 in 0.808s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:20 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83 Jul 05 05:23:20 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (0f47536a-39f5-4df3-b7ff-d721b27b831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0c299a-dc48-420d-86b2-18dcff2c7cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0c299a-dc48-420d-86b2-18dcff2c7cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206772276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49136467-f325-4617-9bc9-f82c3378d1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:20Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a96b308-b7d7-4478-8358-8a01328fff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a96b308-b7d7-4478-8358-8a01328fff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846805f4-9716-4c54-b834-1081922a1d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846805f4-9716-4c54-b834-1081922a1d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49136467-f325-4617-9bc9-f82c3378d1ce', 'volume_name': 'volume-49136467-f325-4617-9bc9-f82c3378d1ce', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5664399a-4922-4405-9721-69022bf28170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5664399a-4922-4405-9721-69022bf28170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4604e3-cfc5-45df-a241-bccf372921e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume 49136467-f325-4617-9bc9-f82c3378d1ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49136467-f325-4617-9bc9-f82c3378d1ce', 'volume_size': 1} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (e37f8ac9-3d33-4ff9-adeb-e5219149e0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64abfd52-1f69-4b82-8c9c-f3411f07b4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64abfd52-1f69-4b82-8c9c-f3411f07b4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988395384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d67f809-c1ba-4437-858c-4518361fb884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:21Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f32c34-384a-4941-8bec-a73ba2c8ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f32c34-384a-4941-8bec-a73ba2c8ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc520e0d-2c22-4e61-904a-65cfb3343ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc520e0d-2c22-4e61-904a-65cfb3343ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d67f809-c1ba-4437-858c-4518361fb884', 'volume_name': 'volume-0d67f809-c1ba-4437-858c-4518361fb884', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55da6c95-905f-42ea-9e2e-71eac0777c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55da6c95-905f-42ea-9e2e-71eac0777c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7aacec-5a0d-4f9a-87f4-bc171f381c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume 0d67f809-c1ba-4437-858c-4518361fb884: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d67f809-c1ba-4437-858c-4518361fb884', 'volume_size': 1} Jul 05 05:23:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:21 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (9cc8c2c9-0524-48ec-85ea-28d82ebba137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef6fddc-8791-4c22-8ac2-0e25a2c624d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951.3e267ba7-01b9-4e51-84cd-7c1605680a83" returned: 0 in 0.860s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-3e267ba7-01b9-4e51-84cd-7c1605680a83" released by "_delete_snapshot" :: held 3.462s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef6fddc-8791-4c22-8ac2-0e25a2c624d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1169794586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d74fbd-bfec-48ab-a546-56693ea4207e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:21Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef0848-e9db-4f97-a6f9-662470a265f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef0848-e9db-4f97-a6f9-662470a265f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2254dc16-a18c-41be-97c8-a1797cc23e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2254dc16-a18c-41be-97c8-a1797cc23e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d74fbd-bfec-48ab-a546-56693ea4207e', 'volume_name': 'volume-c6d74fbd-bfec-48ab-a546-56693ea4207e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201383d9-dd18-444c-aea8-90e590a3b64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201383d9-dd18-444c-aea8-90e590a3b64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0080072-d351-47b3-9016-4183ad04d844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume c6d74fbd-bfec-48ab-a546-56693ea4207e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d74fbd-bfec-48ab-a546-56693ea4207e', 'volume_size': 1} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" released by "delete_snapshot" :: held 3.593s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:21 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Created reservations ['5bdf980b-595a-41f6-865d-fe87cda46d89', '1d3484ad-545c-4ca1-9be2-4bb141c59046', '3351d150-8406-4afb-b586-ffe75625083c', '1520a4c1-d1c9-41fc-93cf-8fba6bb26114'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Delete snapshot completed successfully. Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-3e267ba7-01b9-4e51-84cd-7c1605680a83-delete_snapshot" released by "delete_snapshot" :: held 4.455s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Snapshots deleted, issuing volume delete {{(pid=86688) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" acquired by "delete_volume" :: waited 0.099s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (85d63603-3347-457a-bfe7-c12f9e5c7113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626e0b87-9627-4ef9-ac8b-30e50ffb0f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[842c1749-5429-43a2-8fab-ece206dc4b60]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626e0b87-9627-4ef9-ac8b-30e50ffb0f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770875281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ff42fc-9178-443c-9a93-7b17448a4353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:22Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f43008e-f57d-4731-931c-642833199dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f43008e-f57d-4731-931c-642833199dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1693359d-734f-4102-8747-ba8f17fe9aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1693359d-734f-4102-8747-ba8f17fe9aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ff42fc-9178-443c-9a93-7b17448a4353', 'volume_name': 'volume-51ff42fc-9178-443c-9a93-7b17448a4353', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e110c-46fd-4a2f-a957-00bb6ebc0fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:22 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 Jul 05 05:23:22 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b8e110c-46fd-4a2f-a957-00bb6ebc0fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deab9cf-3965-4571-879d-d8bdfd91a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:22 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume 51ff42fc-9178-443c-9a93-7b17448a4353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ff42fc-9178-443c-9a93-7b17448a4353', 'volume_size': 1} Jul 05 05:23:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (eb1fb07e-9687-45bb-a7d8-cf93adb0b995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6544ef-9b61-4d7f-ab95-339a71c8131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6544ef-9b61-4d7f-ab95-339a71c8131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199356941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb76c1ab-7afd-429c-9bad-256e1f6576d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:23Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a544e0f7-2ac1-45de-81bc-f23753fd08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a544e0f7-2ac1-45de-81bc-f23753fd08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02dc28e-eee2-40f7-97e6-5d56bf9855a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02dc28e-eee2-40f7-97e6-5d56bf9855a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb76c1ab-7afd-429c-9bad-256e1f6576d8', 'volume_name': 'volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe341d29-8f84-4544-a2a2-1dde37573dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe341d29-8f84-4544-a2a2-1dde37573dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c6146-498a-495e-b61f-de29653a44ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume bb76c1ab-7afd-429c-9bad-256e1f6576d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8', 'volume_size': 1} Jul 05 05:23:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:24 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" returned: 0 in 1.963s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:24 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951 Jul 05 05:23:24 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:25 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" returned: 0 in 1.095s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951" released by "delete_volume" :: held 3.451s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:25 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img" returned: 0 in 5.570s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Created reservations ['30ac59ac-ec10-4675-bc80-34a3610ad3aa', 'c2dfb67e-0d21-4a8b-bedf-4bd57b5c4524', 'cbe36cb7-e8e8-46fb-be4c-2ace846ad5e2', 'b4a3cb60-9fd7-41fe-a635-0f191f55186f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[76949671-32c8-47c8-9adb-647130f64283]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:25 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:25 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:25 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:23:25 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:26 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.657s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Deleted volume successfully. Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-24a9cadc-660b-4739-9bae-ae937875e645 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-5e43b7cd-3fd7-4575-b1d5-2a4f92ac8951-delete_volume" released by "delete_volume" :: held 8.899s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-d393a556-a637-4b02-b6dd-0e0b08aca619-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:26 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.989s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:23:26 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Converted 1024.00 MB image at 183.79 MB/s Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-d393a556-a637-4b02-b6dd-0e0b08aca619-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9b was raw, converting to qcow2 {{(pid=86688) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb63fcf-e197-4b51-aff2-dabe4407aca4]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "cinder-quobyte-d393a556-a637-4b02-b6dd-0e0b08aca619" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d393a556-a637-4b02-b6dd-0e0b08aca619" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71b05f5-7388-4e82-ab0d-421c685d0455]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:26 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img Jul 05 05:23:26 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:27 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 Jul 05 05:23:27 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:27 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img" returned: 0 in 0.737s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:27 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619" returned: 0 in 0.752s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:27 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619 Jul 05 05:23:27 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:27 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img Jul 05 05:23:27 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:28 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img" returned: 1 in 0.713s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img /opt/stack/data/cinder/conversion/vol_upload_ydq5sv47 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:28 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d393a556-a637-4b02-b6dd-0e0b08aca619" returned: 0 in 0.666s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:28 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img /opt/stack/data/cinder/conversion/vol_upload_ydq5sv47 Jul 05 05:23:28 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-quobyte-d393a556-a637-4b02-b6dd-0e0b08aca619" released by "delete_volume" :: held 1.456s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Created reservations ['a0ddfeab-9edb-4c02-9260-7e06b5571ce7', 'bc4d0fc8-cbc5-45d1-96d9-5619396432fd', 'd7cf56de-1569-4f02-90a8-53ad71679d46', '0ce4238f-7ca2-4e9d-84a9-ae0f39314774'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:28 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:28 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:29 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img /opt/stack/data/cinder/conversion/vol_upload_ydq5sv47" returned: 0 in 0.708s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Image conversion details: src /opt/stack/data/cinder/conversion/b604bd59-cb9e-44bd-b699-553e50b4cd7a.temp_image.aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9benix2ky6.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ydq5sv47 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:23:29 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f2696b-773e-464b-b9b3-fa29e64678b4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ydq5sv47 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:29 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ydq5sv47 Jul 05 05:23:29 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:29 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.715s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Deleted volume successfully. Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f601a35-7f2f-4f2d-8970-3088cc2db2f2 tempest-VolumesDeleteCascade-199973598 None] Lock "cinder-d393a556-a637-4b02-b6dd-0e0b08aca619-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:29 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ydq5sv47" returned: 0 in 0.812s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:23:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:30 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:30 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:31 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.871s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Uploaded volume to glance image-id: aafbe0ea-949c-423a-a3e1-8cbfbbdb1a9b. {{(pid=86688) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 21.578s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Creating offline snapshot d09001a3-2ac8-41cf-8ae6-3c682edf5d3e of volume 8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:23:31 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-223f246b-aac0-4b13-9e64-93568de1fbcb tempest-VolumesActionsTest-833525332 None] Copy volume to image completed successfully. Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921d158-f09b-4e72-8332-72c2b82bb588]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:31 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb Jul 05 05:23:31 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:32 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" returned: 0 in 0.780s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:32 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e 1G Jul 05 05:23:32 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (25272996-98c0-4185-b00c-380aec03deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f9d83e-ba01-4088-9620-048bb95ff33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f9d83e-ba01-4088-9620-048bb95ff33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1053201616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c212ff-7a13-44be-82e7-617e81980d75,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:32Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2463db92-8640-410a-9dfd-d4dea6a20346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2463db92-8640-410a-9dfd-d4dea6a20346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edba00b-8720-4991-85b0-52f1d64a14c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7edba00b-8720-4991-85b0-52f1d64a14c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c212ff-7a13-44be-82e7-617e81980d75', 'volume_name': 'volume-b3c212ff-7a13-44be-82e7-617e81980d75', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffaecc2-e837-4651-9bf4-da939f0c45a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ffaecc2-e837-4651-9bf4-da939f0c45a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7d97de-cc32-43ab-8c75-29aed60fb296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:32 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Volume b3c212ff-7a13-44be-82e7-617e81980d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c212ff-7a13-44be-82e7-617e81980d75', 'volume_size': 1} Jul 05 05:23:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Acquiring lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Acquiring lock "cinder-quobyte-b604bd59-cb9e-44bd-b699-553e50b4cd7a" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Lock "cinder-quobyte-b604bd59-cb9e-44bd-b699-553e50b4cd7a" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf6206-b585-4298-8c09-cb51cdaf78f8]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:33 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e 1G" returned: 0 in 0.965s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:33 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e Jul 05 05:23:33 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:33 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:23:33 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:33 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.818s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:34 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a Jul 05 05:23:34 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:34 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:34 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e is being set with open permissions: ugo+rw Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:34 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e Jul 05 05:23:34 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:34 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b604bd59-cb9e-44bd-b699-553e50b4cd7a" returned: 0 in 0.656s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Lock "cinder-quobyte-b604bd59-cb9e-44bd-b699-553e50b4cd7a" released by "delete_volume" :: held 1.528s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:34 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" returned: 0 in 0.698s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Created reservations ['7e6f33e1-a41c-42c4-8096-cb533ffaa9f9', 'a9627948-0514-4f57-ba10-72a163717923', '81d3f784-5850-4327-b0ac-01d4ab431cf9', '575c2973-e5b2-4e54-8619-68347b730827'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:34 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.info Jul 05 05:23:34 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:34 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:34 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:35 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.info" returned: 0 in 0.676s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:35 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.info is being set with open permissions: ugo+rw Jul 05 05:23:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:35 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.info Jul 05 05:23:35 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:35 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.688s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:35 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Deleted volume successfully. Jul 05 05:23:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f922418d-2516-46be-b9ca-065bebbb4938 tempest-VolumesActionsTest-833525332 None] Lock "cinder-b604bd59-cb9e-44bd-b699-553e50b4cd7a-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:36 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.info" returned: 0 in 0.675s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.665s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.696s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206772276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49136467-f325-4617-9bc9-f82c3378d1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:20Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Creating volume 49136467-f325-4617-9bc9-f82c3378d1ce {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:36 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:36 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce 1073741824 Jul 05 05:23:36 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-748c52eb-1ec0-4497-a5ed-f7279548654b tempest-VolumesSnapshotTestJSON-1113350108 None] Create snapshot completed successfully Jul 05 05:23:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (36a8c402-26a2-487a-99fd-71ac4b9a36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac803c22-6fab-4c06-9641-25f5534ad230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac803c22-6fab-4c06-9641-25f5534ad230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-349535011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580dfd9dddae4b7494c7e03b3f60a83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d09001a3-2ac8-41cf-8ae6-3c682edf5d3e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:37Z,use_quota=True,user_id='831a476347f74c398d504e807cf0f0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a581c0a-6ca3-4efb-b78f-4c567f9ee57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a581c0a-6ca3-4efb-b78f-4c567f9ee57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffee8d02-f865-4c95-bddf-3efc90908f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffee8d02-f865-4c95-bddf-3efc90908f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3', 'volume_name': 'volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3', 'volume_size': 1, 'snapshot_id': 'd09001a3-2ac8-41cf-8ae6-3c682edf5d3e'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979cfe29-c496-4234-b7e1-0c328d95c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979cfe29-c496-4234-b7e1-0c328d95c76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda6fdd6-012d-424a-bb84-fdd27795f4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3', 'volume_size': 1, 'snapshot_id': 'd09001a3-2ac8-41cf-8ae6-3c682edf5d3e'} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:37 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce 1073741824" returned: 0 in 0.970s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:37 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce Jul 05 05:23:37 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:37 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce" returned: 0 in 0.678s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.023s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988395384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d67f809-c1ba-4437-858c-4518361fb884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:21Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Creating volume 0d67f809-c1ba-4437-858c-4518361fb884 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:37 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4604e3-cfc5-45df-a241-bccf372921e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49136467-f325-4617-9bc9-f82c3378d1ce', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612ddb32-acc5-4bb7-b1d8-9aa3cb68c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:37 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 1073741824 Jul 05 05:23:37 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume volume-49136467-f325-4617-9bc9-f82c3378d1ce (49136467-f325-4617-9bc9-f82c3378d1ce): created successfully Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612ddb32-acc5-4bb7-b1d8-9aa3cb68c3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (0f47536a-39f5-4df3-b7ff-d721b27b831e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-948fa4ec-eb1e-4e86-81e5-68baab61e481 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created volume successfully. Jul 05 05:23:38 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 1073741824" returned: 0 in 0.960s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:38 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 Jul 05 05:23:38 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:39 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884" returned: 0 in 0.716s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.192s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1169794586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d74fbd-bfec-48ab-a546-56693ea4207e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:21Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Creating volume c6d74fbd-bfec-48ab-a546-56693ea4207e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:39 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7aacec-5a0d-4f9a-87f4-bc171f381c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d67f809-c1ba-4437-858c-4518361fb884', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:39 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e 1073741824 Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb08d2d0-b30f-4242-a5a8-d4be000fe7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:39 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:39 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume volume-0d67f809-c1ba-4437-858c-4518361fb884 (0d67f809-c1ba-4437-858c-4518361fb884): created successfully Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb08d2d0-b30f-4242-a5a8-d4be000fe7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (e37f8ac9-3d33-4ff9-adeb-e5219149e0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-59324698-e275-477e-ba52-5e1dacb9523a tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created volume successfully. Jul 05 05:23:40 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e 1073741824" returned: 0 in 0.916s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:40 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e Jul 05 05:23:40 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:41 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e" returned: 0 in 0.655s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.212s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770875281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ff42fc-9178-443c-9a93-7b17448a4353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:22Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Creating volume 51ff42fc-9178-443c-9a93-7b17448a4353 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:41 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0080072-d351-47b3-9016-4183ad04d844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d74fbd-bfec-48ab-a546-56693ea4207e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ccd73-696b-48c0-b749-65815b687f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:41 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 1073741824 Jul 05 05:23:41 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume volume-c6d74fbd-bfec-48ab-a546-56693ea4207e (c6d74fbd-bfec-48ab-a546-56693ea4207e): created successfully Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ccd73-696b-48c0-b749-65815b687f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (9cc8c2c9-0524-48ec-85ea-28d82ebba137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7ac2461e-706d-4315-b08d-b556939b5bae tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created volume successfully. Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Flow 'volume_create_manager' (03266b9e-7433-4060-8a33-b4b30d147a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36272569-a408-4601-9722-1b091656e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36272569-a408-4601-9722-1b091656e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1815683522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a618ea-e6ad-4c98-861f-e0bee2bdce8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a898ea1eb786409e98213be7349fa755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:41Z,use_quota=True,user_id='0c733d782d9148aeaaa5eb2063bd33b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43aae5-2b26-46c3-91e7-78a058496564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43aae5-2b26-46c3-91e7-78a058496564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd559c2-2872-49bc-b316-d2687fa351e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd559c2-2872-49bc-b316-d2687fa351e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a618ea-e6ad-4c98-861f-e0bee2bdce8f', 'volume_name': 'volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f', 'volume_size': 2}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea0b6c7-ab66-46f0-840b-a45eed60d92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea0b6c7-ab66-46f0-840b-a45eed60d92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e116d41-03cc-4d3a-a72a-1310a09fbf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Volume 55a618ea-e6ad-4c98-861f-e0bee2bdce8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f', 'volume_size': 2} Jul 05 05:23:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:42 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 1073741824" returned: 0 in 0.859s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:42 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 Jul 05 05:23:42 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:42 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353" returned: 0 in 0.648s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.121s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1199356941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb76c1ab-7afd-429c-9bad-256e1f6576d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb2edde5d4104db09a60a8d86c50b54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:23Z,use_quota=True,user_id='478e3765acf1494ab68ce6c43a4716db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Creating volume bb76c1ab-7afd-429c-9bad-256e1f6576d8 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:42 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8deab9cf-3965-4571-879d-d8bdfd91a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ff42fc-9178-443c-9a93-7b17448a4353', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:42 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 1073741824 Jul 05 05:23:42 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d07d15-5194-4661-8aa1-c4dfbc094c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume volume-51ff42fc-9178-443c-9a93-7b17448a4353 (51ff42fc-9178-443c-9a93-7b17448a4353): created successfully Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d07d15-5194-4661-8aa1-c4dfbc094c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (85d63603-3347-457a-bfe7-c12f9e5c7113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f882df09-ee36-4a73-acae-5651479bc746 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created volume successfully. Jul 05 05:23:43 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 1073741824" returned: 0 in 0.825s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:43 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 Jul 05 05:23:43 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:44 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8" returned: 0 in 0.636s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.860s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1053201616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c212ff-7a13-44be-82e7-617e81980d75,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:32Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Creating volume b3c212ff-7a13-44be-82e7-617e81980d75 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:44 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3c6146-498a-495e-b61f-de29653a44ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd745db6-5dd8-420f-9ede-88227d2453c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:44 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 1073741824 Jul 05 05:23:44 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:44 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Volume volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 (bb76c1ab-7afd-429c-9bad-256e1f6576d8): created successfully Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd745db6-5dd8-420f-9ede-88227d2453c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Flow 'volume_create_manager' (eb1fb07e-9687-45bb-a7d8-cf93adb0b995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f4d77bad-9688-46a3-bd68-8286b1e6c9a2 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created volume successfully. Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-bb76c1ab-7afd-429c-9bad-256e1f6576d8-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-bb76c1ab-7afd-429c-9bad-256e1f6576d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:45 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-quobyte-bb76c1ab-7afd-429c-9bad-256e1f6576d8" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 1073741824" returned: 0 in 0.841s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-bb76c1ab-7afd-429c-9bad-256e1f6576d8" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92a81c0-6a91-478d-b5be-dab40937d824]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:45 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 Jul 05 05:23:45 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:45 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 Jul 05 05:23:45 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:45 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75" returned: 0 in 0.670s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.745s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7d97de-cc32-43ab-8c75-29aed60fb296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c212ff-7a13-44be-82e7-617e81980d75', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9cf59e6-7a38-4b74-9db3-64568baa820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Creating volume b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 from snapshot d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:45 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Volume volume-b3c212ff-7a13-44be-82e7-617e81980d75 (b3c212ff-7a13-44be-82e7-617e81980d75): created successfully Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9cf59e6-7a38-4b74-9db3-64568baa820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:45 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (25272996-98c0-4185-b00c-380aec03deca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] snapshot: d09001a3-2ac8-41cf-8ae6-3c682edf5d3e, volume: b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8" returned: 0 in 0.785s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:45 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-098a0595-79fc-4a03-8bd8-930f7b6da1be tempest-VolumesGetTest-1759722072 None] Created volume successfully. Jul 05 05:23:45 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8 Jul 05 05:23:45 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[18542f82-fb01-4c01-9900-2e4061ab2f2d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:46 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e Jul 05 05:23:46 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:46 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-bb76c1ab-7afd-429c-9bad-256e1f6576d8" returned: 0 in 0.738s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-bb76c1ab-7afd-429c-9bad-256e1f6576d8" released by "delete_volume" :: held 1.572s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created reservations ['bc568ced-cdcb-49f6-9ada-04e8dfdb8428', 'b199585c-6427-4ddf-9000-4bb1d99da0d6', 'cd794aca-9dc9-4fdb-8ac7-ecfc272020a8', '98c36f81-9de1-49b1-8bbe-7b94bc17768a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:46 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:46 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:46 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (b50145a3-298b-4a7c-9d76-3f012b1c8c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063f3d43-ade0-4bab-8f27-763cd08ac651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" returned: 0 in 0.941s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063f3d43-ade0-4bab-8f27-763cd08ac651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-983775975',display_name='tempest-VolumesGetTest-Volume-1087041503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240bdd6d-280e-4040-b21a-dd9d1fc7631f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:47Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d292dbf-0752-4182-b5ed-a7ae441318a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d292dbf-0752-4182-b5ed-a7ae441318a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828e59c-c7b7-4439-a37d-31ad71c9245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828e59c-c7b7-4439-a37d-31ad71c9245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240bdd6d-280e-4040-b21a-dd9d1fc7631f', 'volume_name': 'volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4342d4e-507c-4f76-a4a7-77fdb106fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4342d4e-507c-4f76-a4a7-77fdb106fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e902ace-82a0-4bed-8002-c5de982a80a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:47 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Volume 240bdd6d-280e-4040-b21a-dd9d1fc7631f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f', 'volume_size': 1} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f5c05c-d183-494f-9c4e-d5a540977e7f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:47 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb Jul 05 05:23:47 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-51ff42fc-9178-443c-9a93-7b17448a4353-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-51ff42fc-9178-443c-9a93-7b17448a4353-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-quobyte-51ff42fc-9178-443c-9a93-7b17448a4353" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-51ff42fc-9178-443c-9a93-7b17448a4353" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71e562-9b40-4c98-a000-3c577b68cbcb]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:47 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.703s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Deleted volume successfully. Jul 05 05:23:47 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 Jul 05 05:23:47 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9fd814d6-e164-4db8-b81e-878e3bc00ef8 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-bb76c1ab-7afd-429c-9bad-256e1f6576d8-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:47 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" returned: 0 in 0.852s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:23:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:47 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 Jul 05 05:23:47 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:48 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:48 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353 Jul 05 05:23:48 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:49 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-51ff42fc-9178-443c-9a93-7b17448a4353" returned: 0 in 0.817s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-51ff42fc-9178-443c-9a93-7b17448a4353" released by "delete_volume" :: held 1.656s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created reservations ['2e74bcd5-6fa6-4346-b6d2-cd2e938121c0', '02212f71-962f-4e10-bd56-0b87ac79b764', '13c43c00-1076-4951-b026-a644ed04b89a', '941bc73e-4ce9-4486-8f0b-20b7fd224da5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:49 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:49 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-c6d74fbd-bfec-48ab-a546-56693ea4207e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-c6d74fbd-bfec-48ab-a546-56693ea4207e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-quobyte-c6d74fbd-bfec-48ab-a546-56693ea4207e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-c6d74fbd-bfec-48ab-a546-56693ea4207e" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0ed435-9fa3-4412-90c5-0c340a74f732]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:50 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e Jul 05 05:23:50 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:50 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.593s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:51 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Deleted volume successfully. Jul 05 05:23:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-91fa038b-7346-487f-a116-2480a76b973c tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-51ff42fc-9178-443c-9a93-7b17448a4353-delete_volume" released by "delete_volume" :: held 3.721s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:51 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e" returned: 0 in 1.249s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:51 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e Jul 05 05:23:51 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:53 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" returned: 0 in 5.352s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[72769ab8-9222-4c69-b0db-7b0c5e5456f2]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:53 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6d74fbd-bfec-48ab-a546-56693ea4207e" returned: 0 in 2.041s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-c6d74fbd-bfec-48ab-a546-56693ea4207e" released by "delete_volume" :: held 3.372s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created reservations ['262fe32f-64fa-4893-90d6-9a7efba2e7a5', '55186e7f-c298-4a23-9018-55e4db2a5f40', '4eaca4d7-2bd5-408e-a2e9-dab74bdbb4ac', '7b99bed1-9080-4b2d-8a8f-205bf2d2f9ae'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:53 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb Jul 05 05:23:53 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:53 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:53 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:54 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.657s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Deleted volume successfully. Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4f16ee53-8926-49a3-ba48-60327fc55ed6 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-c6d74fbd-bfec-48ab-a546-56693ea4207e-delete_volume" released by "delete_volume" :: held 4.308s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:54 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" returned: 0 in 0.973s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:23:54 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Converted 1024.00 MB image at 191.28 MB/s Jul 05 05:23:54 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 is being set with open permissions: ugo+rw Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:54 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 Jul 05 05:23:54 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-0d67f809-c1ba-4437-858c-4518361fb884-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-0d67f809-c1ba-4437-858c-4518361fb884-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-quobyte-0d67f809-c1ba-4437-858c-4518361fb884" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-0d67f809-c1ba-4437-858c-4518361fb884" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[711e1c82-86b3-4d1f-b3e7-350b14883399]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:54 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 Jul 05 05:23:54 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:54 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" returned: 0 in 0.696s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" released by "_copy_volume_from_snapshot" :: held 8.976s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" released by "_create_volume_from_snapshot" :: held 9.026s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.065s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.343s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1815683522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a618ea-e6ad-4c98-861f-e0bee2bdce8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a898ea1eb786409e98213be7349fa755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:41Z,use_quota=True,user_id='0c733d782d9148aeaaa5eb2063bd33b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Creating volume 55a618ea-e6ad-4c98-861f-e0bee2bdce8f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:54 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f 2147483648 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:54 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f 2147483648 Jul 05 05:23:54 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda6fdd6-012d-424a-bb84-fdd27795f4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3', 'volume_size': 1, 'snapshot_id': 'd09001a3-2ac8-41cf-8ae6-3c682edf5d3e'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50661a12-c414-415d-b8ee-c29f10a4acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:55 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Volume volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 (b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3): created successfully Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50661a12-c414-415d-b8ee-c29f10a4acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Flow 'volume_create_manager' (36a8c402-26a2-487a-99fd-71ac4b9a36a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:55 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-eb557958-34c9-420c-89de-41930a4d9c97 tempest-VolumesSnapshotTestJSON-1113350108 None] Created volume successfully. Jul 05 05:23:55 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884" returned: 0 in 0.760s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:55 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884 Jul 05 05:23:55 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[773d6042-db01-4ea1-b523-70217200c1c7]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:55 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 Jul 05 05:23:55 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:55 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0d67f809-c1ba-4437-858c-4518361fb884" returned: 0 in 0.678s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-0d67f809-c1ba-4437-858c-4518361fb884" released by "delete_volume" :: held 1.488s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:55 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created reservations ['f0439147-1d75-4beb-a6f3-4598734c0555', '0fc8cc3a-803d-4b09-b702-2fa6263c2399', '793fb28b-8241-4e45-979c-efe16193dca8', '0fc47c7d-578a-42a7-82e6-0d8aaec5e40a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f 2147483648" returned: 0 in 0.997s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:56 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f Jul 05 05:23:56 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:56 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:56 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:56 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" returned: 0 in 0.837s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:56 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3 Jul 05 05:23:56 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-49136467-f325-4617-9bc9-f82c3378d1ce-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-49136467-f325-4617-9bc9-f82c3378d1ce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-quobyte-49136467-f325-4617-9bc9-f82c3378d1ce" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-49136467-f325-4617-9bc9-f82c3378d1ce" acquired by "delete_volume" :: waited 0.034s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c2d95-6d22-4956-a38a-64549ea9385c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:56 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.762s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Deleted volume successfully. Jul 05 05:23:56 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f" returned: 0 in 0.847s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.818s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:23:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-983775975',display_name='tempest-VolumesGetTest-Volume-1087041503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240bdd6d-280e-4040-b21a-dd9d1fc7631f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:23:47Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Creating volume 240bdd6d-280e-4040-b21a-dd9d1fc7631f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:23:56 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ff1d91f-b909-4691-8449-14275135c8d9 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-0d67f809-c1ba-4437-858c-4518361fb884-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e116d41-03cc-4d3a-a72a-1310a09fbf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f', 'volume_size': 2}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:56 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f 1073741824 Jul 05 05:23:56 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4c13ab-209a-4aef-b896-c2b2020602cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:56 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Volume volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f (55a618ea-e6ad-4c98-861f-e0bee2bdce8f): created successfully Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4c13ab-209a-4aef-b896-c2b2020602cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Flow 'volume_create_manager' (03266b9e-7433-4060-8a33-b4b30d147a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c2ad8852-fa36-407f-811c-b1213954b2a6 tempest-VolumesCloneNegativeTest-1335516326 None] Created volume successfully. Jul 05 05:23:56 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce Jul 05 05:23:56 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:57 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" returned: 0 in 0.743s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3" released by "delete_volume" :: held 1.626s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['2cf0924f-0ef5-4881-982f-ebcd5fc3fc73', '0e8f3036-9c89-457c-b2dd-55c901138661', '33579588-b349-4276-89a5-19c80e53a5ee', 'b4b1f984-94a0-486f-86c9-8ee98f1a55f2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:57 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:57 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:57 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce" returned: 0 in 0.842s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:57 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce Jul 05 05:23:57 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:57 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f 1073741824" returned: 0 in 1.013s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Deleting offline snapshot d09001a3-2ac8-41cf-8ae6-3c682edf5d3e of volume 8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] snapshot_file for this snap is: volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:23:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f0582b-416f-432d-8c0a-194eec17975d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:58 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f Jul 05 05:23:58 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:58 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Acquiring lock "cinder-55a618ea-e6ad-4c98-861f-e0bee2bdce8f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.879s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Deleted volume successfully. Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "cinder-55a618ea-e6ad-4c98-861f-e0bee2bdce8f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ca667fa5-12bd-43c0-b0a0-6c790ef1860d tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-b7d4fbd0-86b1-409c-ae9b-bf3415f18aa3-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:58 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e Jul 05 05:23:58 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Acquiring lock "cinder-quobyte-55a618ea-e6ad-4c98-861f-e0bee2bdce8f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "cinder-quobyte-55a618ea-e6ad-4c98-861f-e0bee2bdce8f" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[07300fa4-0a11-405b-8afd-aa680ce29a6e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:58 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f Jul 05 05:23:58 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:58 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-49136467-f325-4617-9bc9-f82c3378d1ce" returned: 0 in 0.861s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-49136467-f325-4617-9bc9-f82c3378d1ce" released by "delete_volume" :: held 1.776s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created reservations ['1a11d0e3-eb03-4a24-afb5-254eb9bfa4ce', 'e55015ff-9f6b-4985-900c-874ebd65d9b5', 'c276bbf1-4248-4d5f-b628-7765d2a47aa8', '6a972258-8d63-44d8-8c34-29571e8411ee'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:58 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:23:58 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:58 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f" returned: 0 in 0.799s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e902ace-82a0-4bed-8002-c5de982a80a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e69fd2-fcb3-4db9-9975-ef5621e14fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:23:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Volume volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f (240bdd6d-280e-4040-b21a-dd9d1fc7631f): created successfully Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e69fd2-fcb3-4db9-9975-ef5621e14fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (b50145a3-298b-4a7c-9d76-3f012b1c8c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:23:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-94aeeb74-6a0e-4c0d-befe-0bc305e8b8f8 tempest-VolumesGetTest-1759722072 None] Created volume successfully. Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "cinder-quobyte-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3093d149-0fe1-4046-a73b-6d9141bfb531]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:59 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" returned: 0 in 1.175s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[853ba566-8b5c-4bee-953c-b4269fc60a99]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:59 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f" returned: 0 in 0.987s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:59 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-240bdd6d-280e-4040-b21a-dd9d1fc7631f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:59 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f Jul 05 05:23:59 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:59 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Lock "cinder-240bdd6d-280e-4040-b21a-dd9d1fc7631f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-240bdd6d-280e-4040-b21a-dd9d1fc7631f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:23:59 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb Jul 05 05:23:59 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:23:59 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.830s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-240bdd6d-280e-4040-b21a-dd9d1fc7631f" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:23:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Deleted volume successfully. Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7995551c-2d7b-4b68-8d12-152c40bd0df1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:23:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1466aaa8-acfd-458c-8b49-768dd4597f15 tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-49136467-f325-4617-9bc9-f82c3378d1ce-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:23:59 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f Jul 05 05:23:59 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:00 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce" returned: 0 in 0.956s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:00 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-55a618ea-e6ad-4c98-861f-e0bee2bdce8f" returned: 0 in 0.823s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:00 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce Jul 05 05:24:00 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "cinder-quobyte-55a618ea-e6ad-4c98-861f-e0bee2bdce8f" released by "delete_volume" :: held 1.868s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:00 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Created reservations ['89050e2a-115c-4910-8b11-d1b5c02df8b1', '43219c10-6816-418e-bca0-7385520e498a', '9c27c8d0-08b3-4d8d-83a4-5c1be6494884', '7d835423-2f74-4d34-b8b0-fe6c794cb737'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" returned: 0 in 0.968s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:00 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e Jul 05 05:24:00 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:00 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:00 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:00 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f" returned: 0 in 1.057s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:00 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f Jul 05 05:24:00 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:01 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce" returned: 0 in 0.940s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-quobyte-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce" released by "delete_volume" :: held 1.964s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Created reservations ['5c708233-1b90-4701-8ce2-a09c8ee2d0d1', 'd472bcdd-05a9-4d50-834c-1c326389114f', '294cc51a-a40d-49fe-8290-7dcce5e326c7', 'c670f435-5817-44ba-985a-65d402279e11'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:01 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:01 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:01 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.998s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:01 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Deleted volume successfully. Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-63eb7627-908d-4d58-8d42-8c6968b00b79 tempest-VolumesCloneNegativeTest-1335516326 None] Lock "cinder-55a618ea-e6ad-4c98-861f-e0bee2bdce8f-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:01 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" returned: 0 in 1.180s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:01 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e Jul 05 05:24:01 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:01 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-240bdd6d-280e-4040-b21a-dd9d1fc7631f" returned: 0 in 1.018s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-240bdd6d-280e-4040-b21a-dd9d1fc7631f" released by "delete_volume" :: held 2.184s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Created reservations ['b8ad3462-b53f-48e7-837d-1234a09ab528', '9d867c97-5283-4c23-9ff4-f66703bbfa07', '699538ef-dd21-41f4-905d-c33c89f0ea3c', 'de84b7f2-7128-4a47-bda4-cc307311c68c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:01 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:01 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:02 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.121s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Deleted volume successfully. Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52d620bd-bfeb-474c-b4ff-949813882fbe tempest-CreateVolumesFromSourceVolumeTest-665206249 None] Lock "cinder-d50e2569-9ab8-4a66-b62c-f7845b6dc7ce-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:02 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb.d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" returned: 0 in 1.105s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e" released by "_delete_snapshot" :: held 4.584s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" released by "delete_snapshot" :: held 4.614s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['fccc0cb5-4efc-4b68-9175-24f0a88e8ba4', '2b876555-331e-4984-bc82-00d46a662aaa', 'bc2b6a7b-3530-4f62-b74a-7db4153193bc', '77976e01-c47d-4ece-b458-6de42b68a753'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Delete snapshot completed successfully. Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e835a81-4f6c-4d2a-9a48-f43013b2c0f3 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-d09001a3-2ac8-41cf-8ae6-3c682edf5d3e-delete_snapshot" released by "delete_snapshot" :: held 4.818s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:02 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.039s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-b3c212ff-7a13-44be-82e7-617e81980d75-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Deleted volume successfully. Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Lock "cinder-b3c212ff-7a13-44be-82e7-617e81980d75-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-356b24a1-7e7b-4686-9098-edad0ef27eb0 tempest-VolumesGetTest-1759722072 None] Lock "cinder-240bdd6d-280e-4040-b21a-dd9d1fc7631f-delete_volume" released by "delete_volume" :: held 3.652s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-b3c212ff-7a13-44be-82e7-617e81980d75" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-b3c212ff-7a13-44be-82e7-617e81980d75" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[980779aa-e7b4-45c0-a474-9041f093dd80]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:03 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 Jul 05 05:24:03 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d96c0-5876-4c41-92ad-24c1c881ce80]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:03 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb Jul 05 05:24:03 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:04 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75" returned: 0 in 0.889s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:04 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75 Jul 05 05:24:04 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:04 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" returned: 0 in 1.085s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:04 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb Jul 05 05:24:04 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:04 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b3c212ff-7a13-44be-82e7-617e81980d75" returned: 0 in 0.817s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-b3c212ff-7a13-44be-82e7-617e81980d75" released by "delete_volume" :: held 1.766s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Created reservations ['d3ca1280-2244-4413-bf3a-11922b684d8a', 'eb4cd050-0ad5-43ea-ae8e-ab200f9266e2', '3df06acf-4bf7-4468-a62a-0f2309935e64', '44fb9a5b-7c75-4d96-b6b2-c49ec5910abb'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:05 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:05 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:05 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb" released by "delete_volume" :: held 1.949s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['66ca9886-1002-475a-bf87-0f81e16ae6fd', '05ad3d88-79eb-48eb-a0b6-4845504b195f', '3b7270af-8881-4c9c-aa5a-542b16cb27cd', 'becb59dc-80fc-4d07-a957-8924a1cff17e'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:05 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:05 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:05 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Flow 'volume_create_manager' (046102a4-b310-46ab-9204-ef901d12b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b1b40-8fb3-4c2e-b4f7-9fe7cd3c5e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b1b40-8fb3-4c2e-b4f7-9fe7cd3c5e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-552618644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bac334c-e0d0-4eeb-bb72-8bb23d028ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d7a3e368354ed682d095900c158adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:06Z,use_quota=True,user_id='cc598650cea24770ba37167965523b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac89db6f-3358-4701-84b4-0dcd66f947af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac89db6f-3358-4701-84b4-0dcd66f947af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d78b701-dca7-4cb5-8922-23abe77b00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:24:05 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Deleted volume successfully. Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-95717e68-2d87-4a61-91cd-dd5bde519195 tempest-VolumesGetTest-1759722072 None] Lock "cinder-b3c212ff-7a13-44be-82e7-617e81980d75-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-c3baf3d8-685d-4887-ac2f-1b3dc311d505-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-c3baf3d8-685d-4887-ac2f-1b3dc311d505-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Flow 'volume_create_manager' (58c805db-e5da-469f-889f-fc3dbf1cb033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8716295-f6af-4451-a801-28cc69b8ee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8716295-f6af-4451-a801-28cc69b8ee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672128888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2766bd-d02a-4ed3-ac08-a1bd7c4495da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4500eb62c84809a6fedeb5e83b257e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:06Z,use_quota=True,user_id='55754affd54e41f2b9c9185e062ace0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6066a1-b211-414d-b554-bbc13b7e621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6066a1-b211-414d-b554-bbc13b7e621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5c856a-f97c-4fef-bcba-ce43f0445c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5c856a-f97c-4fef-bcba-ce43f0445c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2766bd-d02a-4ed3-ac08-a1bd7c4495da', 'volume_name': 'volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a443e832-2d17-4bcf-967d-39fa54dfaa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a443e832-2d17-4bcf-967d-39fa54dfaa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ed4bc0-028f-41c4-876e-981e15eb5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Volume cc2766bd-d02a-4ed3-ac08-a1bd7c4495da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da', 'volume_size': 1} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672128888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2766bd-d02a-4ed3-ac08-a1bd7c4495da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4500eb62c84809a6fedeb5e83b257e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:06Z,use_quota=True,user_id='55754affd54e41f2b9c9185e062ace0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Creating volume cc2766bd-d02a-4ed3-ac08-a1bd7c4495da {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:06 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:06 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da 1073741824 Jul 05 05:24:06 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "cinder-quobyte-c3baf3d8-685d-4887-ac2f-1b3dc311d505" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-c3baf3d8-685d-4887-ac2f-1b3dc311d505" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (5f44ecf7-d135-4740-9e6b-5a1d26cb488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68059153-8a6c-4504-904f-b3b097807463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[03186e7c-f581-4b3d-82f0-4bc77b5ad327]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68059153-8a6c-4504-904f-b3b097807463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832266107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f04ee4b-610d-49e4-87bb-b7573f80fe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:06Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb87fd1-9c96-40ee-ade6-700ce64ae540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb87fd1-9c96-40ee-ade6-700ce64ae540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2833331d-8a00-4103-baaf-36633f1db907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2833331d-8a00-4103-baaf-36633f1db907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f04ee4b-610d-49e4-87bb-b7573f80fe1f', 'volume_name': 'volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edbf897-02dd-43a9-afe1-f6aaaa8384be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6edbf897-02dd-43a9-afe1-f6aaaa8384be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb4489f-6d62-446a-8b7a-25b5fb812a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Volume 2f04ee4b-610d-49e4-87bb-b7573f80fe1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f', 'volume_size': 1} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d78b701-dca7-4cb5-8922-23abe77b00e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bac334c-e0d0-4eeb-bb72-8bb23d028ca2', 'volume_name': 'volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8162d5d7-df94-4dd9-b3a0-1637bb14a98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8162d5d7-df94-4dd9-b3a0-1637bb14a98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40351877-a5e7-499f-afdc-a9aaf6587f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Volume 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Trying to clone 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:24:06 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 Jul 05 05:24:06 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:06 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.924s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:06 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Deleted volume successfully. Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a8c40ed7-feb1-4d19-92c1-cc1cff150a77 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-8e9390db-8a76-4d21-8e80-3d1ccbfd51eb-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:06 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:24:06 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Image download 20.69 MB at 20.69 MB/s Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c38c039-46d4-4920-94cb-64b2310fea11]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:07 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD Jul 05 05:24:07 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:07 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da 1073741824" returned: 0 in 1.086s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=111,cinder:UPDATE=161,cinder:INSERT=38,cinder:DELETE=9 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=160,cinder:SELECT=115,cinder:DELETE=18,cinder:INSERT=37 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505" returned: 0 in 0.933s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:07 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:07 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505 Jul 05 05:24:07 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:07 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da Jul 05 05:24:07 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:07 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e is fetched for user cc598650cea24770ba37167965523b1a. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[da04ba38-59b5-4bd1-9282-a3d4d770ec61]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:08 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c3baf3d8-685d-4887-ac2f-1b3dc311d505" returned: 0 in 0.705s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:08 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD Jul 05 05:24:08 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-quobyte-c3baf3d8-685d-4887-ac2f-1b3dc311d505" released by "delete_volume" :: held 1.754s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:08 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da" returned: 0 in 0.728s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.623s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-832266107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f04ee4b-610d-49e4-87bb-b7573f80fe1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:06Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Creating volume 2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:08 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Created reservations ['3b2f3cd3-e1e4-47ee-b2fd-1d425db82125', 'c95099ea-ff21-432a-b20b-7f40ae8ca9b3', '883f75a4-c78c-499b-9dd3-191ae0c83a2a', 'f1030c20-86fb-49c0-b429-4987b6e0be42'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ed4bc0-028f-41c4-876e-981e15eb5040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:08 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f 1073741824 Jul 05 05:24:08 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97db8d94-bc8b-4902-bb86-049f8b88e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:08 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Volume volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da (cc2766bd-d02a-4ed3-ac08-a1bd7c4495da): created successfully Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97db8d94-bc8b-4902-bb86-049f8b88e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Flow 'volume_create_manager' (58c805db-e5da-469f-889f-fc3dbf1cb033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ca9a58b4-2130-4498-860c-d56395199670 tempest-ProjectReaderTests-392695887 None] Created volume successfully. Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:08 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:08 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:08 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:09 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.837s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Deleted volume successfully. Jul 05 05:24:09 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f 1073741824" returned: 0 in 1.029s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f65b82d4-ff19-4887-b8ea-3a2a9ef28b58 tempest-VolumesSnapshotTestJSON-1113350108 None] Lock "cinder-c3baf3d8-685d-4887-ac2f-1b3dc311d505-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:09 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f Jul 05 05:24:09 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Acquiring lock "cinder-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Lock "cinder-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Acquiring lock "cinder-quobyte-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Lock "cinder-quobyte-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9dde07-2eb3-4caf-904e-dcef1e8b2f8e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:09 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da Jul 05 05:24:09 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:09 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" returned: 0 in 0.800s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-552618644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bac334c-e0d0-4eeb-bb72-8bb23d028ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d7a3e368354ed682d095900c158adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:06Z,use_quota=True,user_id='cc598650cea24770ba37167965523b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Creating volume 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:10 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:10 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 1073741824 Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb4489f-6d62-446a-8b7a-25b5fb812a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:10 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c425bc6-340a-475e-bd13-151d9903278b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:10 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Volume volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f (2f04ee4b-610d-49e4-87bb-b7573f80fe1f): created successfully Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c425bc6-340a-475e-bd13-151d9903278b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (5f44ecf7-d135-4740-9e6b-5a1d26cb488f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a972330a-63ee-4d99-a6a8-7c7eb60d76ef tempest-VolumesGetTest-1759722072 None] Created volume successfully. Jul 05 05:24:10 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da" returned: 0 in 0.817s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:10 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da Jul 05 05:24:10 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:11 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 1073741824" returned: 0 in 1.076s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:11 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da" returned: 0 in 0.856s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:11 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:11 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Lock "cinder-quobyte-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da" released by "delete_volume" :: held 1.731s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Created reservations ['a43e8045-7e88-40e1-a4de-24e750dd7144', 'caa5edb6-c012-4c52-8fd8-a501d0455d69', '2f563b3a-147e-40ca-bde2-5b416f12f60c', 'd987312c-7b1b-4c28-b0d1-6920b29580ec'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (1f56428f-f31e-497c-94a8-5b36fbb147e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c6ef45-5a21-4820-a2b4-7aed35acc9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c6ef45-5a21-4820-a2b4-7aed35acc9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1837425951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d2f9c82-4c5c-445f-ae96-4afd14ffe38d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2f04ee4b-610d-49e4-87bb-b7573f80fe1f,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:11Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7998c19-cdf0-4f33-a44d-b49b22b793f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7998c19-cdf0-4f33-a44d-b49b22b793f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eedbfb6-fa45-4d5d-aa1c-d92246653ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:11 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:11 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eedbfb6-fa45-4d5d-aa1c-d92246653ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d2f9c82-4c5c-445f-ae96-4afd14ffe38d', 'volume_name': 'volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d', 'volume_size': 1, 'source_volid': '2f04ee4b-610d-49e4-87bb-b7573f80fe1f', 'source_volstatus': 'available'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dac5523-9928-46eb-919a-1702f7b3838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dac5523-9928-46eb-919a-1702f7b3838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97251255-e7a5-4e5d-9362-8638892359fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Volume 6d2f9c82-4c5c-445f-ae96-4afd14ffe38d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d', 'volume_size': 1, 'source_volid': '2f04ee4b-610d-49e4-87bb-b7573f80fe1f', 'source_volstatus': 'available'} Jul 05 05:24:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:12 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 0 in 0.940s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.490s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:12 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Cloning volume 2f04ee4b-610d-49e4-87bb-b7573f80fe1f to volume 6d2f9c82-4c5c-445f-ae96-4afd14ffe38d Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Attempting download of 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Creating offline snapshot d135fc0f-b4ae-403b-9705-7694fa2b1697 of volume 2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[944fc10c-ec47-430a-833b-16f0f64ff6aa]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e143e2-6376-423f-9692-4fa477db434e]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_x4q06_ga {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Flow 'volume_create_manager' (3fcc98d4-d14a-4578-9920-45518a891e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e890cb9-2554-4cb6-b0e5-8f7c3dba8095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e890cb9-2554-4cb6-b0e5-8f7c3dba8095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292396389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a9009e-0a6c-419e-9842-1232700ff91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4500eb62c84809a6fedeb5e83b257e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:12Z,use_quota=True,user_id='55754affd54e41f2b9c9185e062ace0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d63cd4-0b50-480a-adfd-0bb00e6e67d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d63cd4-0b50-480a-adfd-0bb00e6e67d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:12 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0578635-6020-4224-8509-15be399bf2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:12 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0578635-6020-4224-8509-15be399bf2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a9009e-0a6c-419e-9842-1232700ff91e', 'volume_name': 'volume-30a9009e-0a6c-419e-9842-1232700ff91e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:12 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a998371-7223-4f9b-a042-ae0e5367237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a998371-7223-4f9b-a042-ae0e5367237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d974f1-5712-4b51-85da-3ab0f8c1d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:12 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Volume 30a9009e-0a6c-419e-9842-1232700ff91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a9009e-0a6c-419e-9842-1232700ff91e', 'volume_size': 1} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.986s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:12 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Deleted volume successfully. Jul 05 05:24:12 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_x4q06_ga Jul 05 05:24:12 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bbe4c272-34d3-4fc9-8f0a-aa824efd9936 tempest-ProjectReaderTests-392695887 None] Lock "cinder-cc2766bd-d02a-4ed3-ac08-a1bd7c4495da-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:13 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" returned: 0 in 1.007s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:13 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 1G Jul 05 05:24:13 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:13 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_x4q06_ga" returned: 0 in 1.011s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_x4q06_ga {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:13 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_x4q06_ga Jul 05 05:24:13 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:14 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_x4q06_ga" returned: 1 in 0.818s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_x4q06_ga' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f2eef-02fe-4e3f-9a30-b5dbee7a1abd]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:14 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 1G" returned: 0 in 0.899s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:14 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 Jul 05 05:24:14 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:14 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD Jul 05 05:24:14 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:14 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e was qcow2, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:14 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697" returned: 0 in 0.762s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:14 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 is being set with open permissions: ugo+rw Jul 05 05:24:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:14 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:14 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:14 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 Jul 05 05:24:14 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Flow 'volume_create_manager' (05f56b06-a0b3-4672-aab0-2bfcf11af139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c777a1b1-c9e9-49bb-880f-5be26997c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c777a1b1-c9e9-49bb-880f-5be26997c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1903328831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9522806b-cbfc-44c3-ae2d-66a3dea5d17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4939c85da82847fa82d18e476ea07c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:15Z,use_quota=True,user_id='f8db39be65144b76b0fe4d8a954fd2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c53fe-9505-4bf1-9291-8bd90622ef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c53fe-9505-4bf1-9291-8bd90622ef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13d8c61-05f1-424d-a231-5375825a8020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13d8c61-05f1-424d-a231-5375825a8020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9522806b-cbfc-44c3-ae2d-66a3dea5d17e', 'volume_name': 'volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f85fa10-472e-4660-bfa1-c13f510e0aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f85fa10-472e-4660-bfa1-c13f510e0aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cd4de1-a5c6-48b9-a999-83fce6c681d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:15 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e', 'volume_size': 1} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:15 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697" returned: 0 in 0.732s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:15 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.info Jul 05 05:24:15 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:16 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.info" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:16 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.info is being set with open permissions: ugo+rw Jul 05 05:24:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:16 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.info Jul 05 05:24:16 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:16 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 0 in 1.894s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:16 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_s33synngdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:24:16 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Converted 112.00 MB image at 59.04 MB/s Jul 05 05:24:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:16 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 1G Jul 05 05:24:16 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:17 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.info" returned: 0 in 0.733s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] snapshot: d135fc0f-b4ae-403b-9705-7694fa2b1697, volume: 6d2f9c82-4c5c-445f-ae96-4afd14ffe38d, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d0bc19-cd98-460e-a64f-d1654d84e679]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:17 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 Jul 05 05:24:17 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:17 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 1G" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8868788d-2639-45c5-98de-47a1e933e761]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:17 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:17 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:17 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697" returned: 0 in 0.803s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[58044843-d1e5-43c3-82a8-9da6c512ec53]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:18 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f Jul 05 05:24:18 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:18 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 0 in 0.747s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:18 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:18 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:18 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" returned: 0 in 0.782s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:18 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:24:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:18 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d Jul 05 05:24:18 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:19 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 1 in 0.770s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Downloaded image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e for user cc598650cea24770ba37167965523b1a is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Marking volume 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Copying metadata from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e to 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Creating volume glance metadata for volume 6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 backed by image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40351877-a5e7-499f-afdc-a9aaf6587f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a318d8-bf27-434f-83eb-7258c14caf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Volume volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 (6bac334c-e0d0-4eeb-bb72-8bb23d028ca2): created successfully Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a318d8-bf27-434f-83eb-7258c14caf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Flow 'volume_create_manager' (046102a4-b310-46ab-9204-ef901d12b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-57d5c8ea-bcee-4c58-a608-27b632b98c4b tempest-VolumesExtendTest-1452505900 None] Created volume successfully. Jul 05 05:24:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:23 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" returned: 0 in 4.844s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:23 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c873a3b9-cab5-4a7b-ad76-797218ddd455]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:23 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f Jul 05 05:24:23 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:24 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" returned: 0 in 0.924s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:24 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:24:24 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Converted 1024.00 MB image at 211.37 MB/s Jul 05 05:24:24 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d is being set with open permissions: ugo+rw Jul 05 05:24:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:24 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d Jul 05 05:24:24 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:25 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" returned: 0 in 0.628s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" released by "_copy_volume_from_snapshot" :: held 8.058s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-d135fc0f-b4ae-403b-9705-7694fa2b1697" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-d135fc0f-b4ae-403b-9705-7694fa2b1697" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Deleting offline snapshot d135fc0f-b4ae-403b-9705-7694fa2b1697 of volume 2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] snapshot_file for this snap is: volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74735a5-faa5-49c9-91ae-30c55c5c8fbc]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:25 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 Jul 05 05:24:25 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:25 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697" returned: 0 in 0.750s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc6c654-7b68-4dc5-bea5-5f71065cdb91]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:26 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f Jul 05 05:24:26 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:26 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" returned: 0 in 0.758s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:26 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 Jul 05 05:24:26 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:27 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697" returned: 0 in 0.736s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:27 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697 Jul 05 05:24:27 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:28 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f.d135fc0f-b4ae-403b-9705-7694fa2b1697" returned: 0 in 0.658s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-d135fc0f-b4ae-403b-9705-7694fa2b1697" released by "_delete_snapshot" :: held 2.990s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.106s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.717s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292396389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a9009e-0a6c-419e-9842-1232700ff91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4500eb62c84809a6fedeb5e83b257e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:12Z,use_quota=True,user_id='55754affd54e41f2b9c9185e062ace0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Creating volume 30a9009e-0a6c-419e-9842-1232700ff91e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:28 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97251255-e7a5-4e5d-9362-8638892359fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d', 'volume_size': 1, 'source_volid': '2f04ee4b-610d-49e4-87bb-b7573f80fe1f', 'source_volstatus': 'available'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:28 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e 1073741824 Jul 05 05:24:28 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657df03c-07d8-49ed-943f-d4fd7e383b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:28 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Volume volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d (6d2f9c82-4c5c-445f-ae96-4afd14ffe38d): created successfully Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657df03c-07d8-49ed-943f-d4fd7e383b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (1f56428f-f31e-497c-94a8-5b36fbb147e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-187f5c6c-8bac-4c27-8dfe-f795d9aa768b tempest-VolumesGetTest-1759722072 None] Created volume successfully. Jul 05 05:24:29 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e 1073741824" returned: 0 in 0.852s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:29 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e Jul 05 05:24:29 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (9ba3a06d-d2ef-48e5-95d3-8984a5a2215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ace8c33-abc2-40e8-b926-375b02a8039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ace8c33-abc2-40e8-b926-375b02a8039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-263569803',display_name='tempest-VolumesGetTest-Volume-595760757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:29Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52462444-ad32-486e-a2f8-2d2cf693d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52462444-ad32-486e-a2f8-2d2cf693d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729f257c-6894-4835-8d37-1f797622f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (729f257c-6894-4835-8d37-1f797622f27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f90fb4-a517-4c6f-a9ae-9227dac0c0e5', 'volume_name': 'volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33a76a1-c146-4ebd-b466-572a6d12be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33a76a1-c146-4ebd-b466-572a6d12be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58886fca-0644-4b0a-89c0-1d0e5c5c93cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:29 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Volume d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5', 'volume_size': 1} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:29 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e" returned: 0 in 0.686s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.426s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1903328831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9522806b-cbfc-44c3-ae2d-66a3dea5d17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4939c85da82847fa82d18e476ea07c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:15Z,use_quota=True,user_id='f8db39be65144b76b0fe4d8a954fd2b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Creating volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:29 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d974f1-5712-4b51-85da-3ab0f8c1d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a9009e-0a6c-419e-9842-1232700ff91e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:29 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e 1073741824 Jul 05 05:24:29 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8844c2-095c-4efd-9266-986e1452e90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:29 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Volume volume-30a9009e-0a6c-419e-9842-1232700ff91e (30a9009e-0a6c-419e-9842-1232700ff91e): created successfully Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8844c2-095c-4efd-9266-986e1452e90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Flow 'volume_create_manager' (3fcc98d4-d14a-4578-9920-45518a891e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-68cf1f63-10a9-4d80-8d58-1f1cf41e1077 tempest-ProjectReaderTests-392695887 None] Created volume successfully. Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Acquiring lock "cinder-30a9009e-0a6c-419e-9842-1232700ff91e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:30 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:30 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Lock "cinder-30a9009e-0a6c-419e-9842-1232700ff91e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:30 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e 1073741824" returned: 0 in 0.841s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Acquiring lock "cinder-quobyte-30a9009e-0a6c-419e-9842-1232700ff91e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Lock "cinder-quobyte-30a9009e-0a6c-419e-9842-1232700ff91e" acquired by "delete_volume" :: waited 0.039s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:30 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e Jul 05 05:24:30 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb188d1-f382-4719-afbe-21a881359ca7]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:30 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e Jul 05 05:24:30 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:31 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.763s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:24:31 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" returned: 0 in 0.753s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 11.592s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cd4de1-a5c6-48b9-a999-83fce6c681d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ae7953-7380-4a90-8bfa-b2a294e0e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:31 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Volume volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e (9522806b-cbfc-44c3-ae2d-66a3dea5d17e): created successfully Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ae7953-7380-4a90-8bfa-b2a294e0e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Flow 'volume_create_manager' (05f56b06-a0b3-4672-aab0-2bfcf11af139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1150b4-06d5-4481-9c5d-df3f0e7ae285]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:31 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9abf8caa-0855-4a50-ac57-26a1bc43f1b9 tempest-VolumesSnapshotListTestJSON-2028265522 None] Created volume successfully. Jul 05 05:24:31 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:31 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:31 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e" returned: 0 in 0.858s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:31 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e Jul 05 05:24:31 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:32 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 0 in 0.789s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:32 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-30a9009e-0a6c-419e-9842-1232700ff91e" returned: 0 in 0.690s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Lock "cinder-quobyte-30a9009e-0a6c-419e-9842-1232700ff91e" released by "delete_volume" :: held 1.599s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Created reservations ['7010ee0d-2354-43af-9b49-b8554caf93eb', '4dd686f3-0221-4ad6-9d65-f7c6a94e0292', '499c2017-2daa-486a-a62e-102cd7d30ce2', '88fed097-7e81-4bb9-9c3e-854174410772'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:32 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:32 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:32 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:32 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:33 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 1 in 0.836s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 2G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:33 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.755s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 2G" returned: 0 in 0.084s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Deleted volume successfully. Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.773s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.913s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-263569803',display_name='tempest-VolumesGetTest-Volume-595760757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:29Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Creating volume d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:33 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:33 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 1073741824 Jul 05 05:24:33 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0552b707-bb27-4a8a-a588-9c5f61b8bf37 tempest-ProjectReaderTests-392695887 None] Lock "cinder-30a9009e-0a6c-419e-9842-1232700ff91e-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-22e819e7-109e-4a9f-b1c3-10240eb2398f tempest-VolumesExtendTest-1452505900 None] Extend volume completed successfully. Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "cinder-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "cinder-quobyte-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dbbaa0-1574-433e-9fb1-f6d0bb58d674]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:34 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 1073741824" returned: 0 in 1.172s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:34 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:34 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:34 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 Jul 05 05:24:34 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:35 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:35 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5" returned: 0 in 0.755s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 0 in 0.900s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.534s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58886fca-0644-4b0a-89c0-1d0e5c5c93cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79807e24-80df-4049-936f-44890417ee30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Creating offline snapshot f30e9342-20df-4bb1-b1ea-f3faad6931e9 of volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:24:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Volume volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 (d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5): created successfully Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79807e24-80df-4049-936f-44890417ee30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (9ba3a06d-d2ef-48e5-95d3-8984a5a2215f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53204b7-b97a-4446-999f-b2a9ed9b72b6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5a2326d1-4807-4367-887f-32dfc289c553 tempest-VolumesGetTest-1759722072 None] Created volume successfully. Jul 05 05:24:35 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:35 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:35 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e Jul 05 05:24:35 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Lock "cinder-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb31b143-c793-4deb-ab1a-899e5921b7f2]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:36 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 Jul 05 05:24:36 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:36 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 1 in 0.918s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:36 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2 Jul 05 05:24:36 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:36 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" returned: 0 in 0.946s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:36 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 1G Jul 05 05:24:36 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:36 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5" returned: 0 in 0.949s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:36 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" returned: 0 in 0.774s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:36 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5 Jul 05 05:24:36 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2" released by "delete_volume" :: held 2.721s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Created reservations ['156fbaab-9e86-4de9-b879-c5dd814476b9', '7ee20d60-928a-4192-8225-c48b5c5a9647', '7ee4a4eb-96ad-4d68-85ca-67b7f122d438', 'd8f69505-8677-4786-b35b-22c19470be37'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:37 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:37 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:37 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 1G" returned: 0 in 1.085s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:37 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 Jul 05 05:24:37 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:37 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5" returned: 0 in 0.914s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5" released by "delete_volume" :: held 1.930s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:37 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Created reservations ['98cad4e5-a8db-43ad-af6a-884917d6642d', '53debf2d-d3d4-49b5-8b96-80c7be4b882a', '09210281-d292-4e90-ae96-0233ddb0eeee', '0118c1b2-20a6-478d-8612-4c6e2e531bef'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:38 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:38 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:38 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Flow 'volume_create_manager' (e054e72f-3f58-4ab8-969b-bee6624662ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b7a044-de0e-40b0-b0e7-88cc02a16e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.179s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Deleted volume successfully. Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b7a044-de0e-40b0-b0e7-88cc02a16e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1970070944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bb971b-be96-40a2-8713-bbe3247c0cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d7a3e368354ed682d095900c158adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:38Z,use_quota=True,user_id='cc598650cea24770ba37167965523b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735f64bc-5c8d-45e7-84c2-b660e45de270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735f64bc-5c8d-45e7-84c2-b660e45de270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4ebc61-0b92-45db-ae5e-66bf50be8c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4ebc61-0b92-45db-ae5e-66bf50be8c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08bb971b-be96-40a2-8713-bbe3247c0cb5', 'volume_name': 'volume-08bb971b-be96-40a2-8713-bbe3247c0cb5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafc61ab-29ce-4bc3-bf75-c87bbe69c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafc61ab-29ce-4bc3-bf75-c87bbe69c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80aa72c-1c90-477f-890f-55295935cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Volume 08bb971b-be96-40a2-8713-bbe3247c0cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08bb971b-be96-40a2-8713-bbe3247c0cb5', 'volume_size': 1} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Lock "cinder-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ba9c5e57-ed87-4582-8e23-d53c22405a77 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-6bac334c-e0d0-4eeb-bb72-8bb23d028ca2-delete_volume" released by "delete_volume" :: held 4.314s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2dccd0-f64b-4a0c-b224-0922ebb7cc0f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:38 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9" returned: 0 in 1.258s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:38 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 is being set with open permissions: ugo+rw Jul 05 05:24:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:38 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 Jul 05 05:24:38 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:38 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d Jul 05 05:24:38 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:39 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.956s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:39 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Deleted volume successfully. Jul 05 05:24:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-30ab653d-0670-4b79-9847-f22d35e49864 tempest-VolumesGetTest-1759722072 None] Lock "cinder-d4f90fb4-a517-4c6f-a9ae-9227dac0c0e5-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:39 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9" returned: 0 in 0.777s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:39 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" returned: 0 in 0.882s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:39 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.info Jul 05 05:24:39 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:39 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d Jul 05 05:24:39 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:40 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" returned: 0 in 0.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d" released by "delete_volume" :: held 1.690s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:40 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.info" returned: 0 in 0.821s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:40 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.info is being set with open permissions: ugo+rw Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:40 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.info Jul 05 05:24:40 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Created reservations ['83a6ea3d-6b63-43ae-b354-14f90539c0c5', '9acd20aa-17b0-4c77-a80f-c22376d6c89d', 'c452bb75-c41d-4407-b6d0-74367a64190d', 'f4ea4ce3-7272-457a-a9ab-f8f15d223df3'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:40 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:40 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-2f04ee4b-610d-49e4-87bb-b7573f80fe1f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Lock "cinder-2f04ee4b-610d-49e4-87bb-b7573f80fe1f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d64fd06-7564-435a-af0a-a05c300ac696]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:40 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.info" returned: 0 in 0.716s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.752s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.560s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1970070944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08bb971b-be96-40a2-8713-bbe3247c0cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d7a3e368354ed682d095900c158adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:38Z,use_quota=True,user_id='cc598650cea24770ba37167965523b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Creating volume 08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:41 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:41 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f Jul 05 05:24:41 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:41 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 1073741824 Jul 05 05:24:41 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a489e270-ef53-47a4-84cc-fb82c10c6b1e tempest-VolumesSnapshotListTestJSON-2028265522 None] Create snapshot completed successfully Jul 05 05:24:41 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.692s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Deleted volume successfully. Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c3453378-919d-47e0-afcb-1c314195bb1a tempest-VolumesGetTest-1759722072 None] Lock "cinder-6d2f9c82-4c5c-445f-ae96-4afd14ffe38d-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:41 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" returned: 0 in 0.865s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:41 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f Jul 05 05:24:41 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:41 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 1073741824" returned: 0 in 0.861s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:41 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 Jul 05 05:24:41 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:42 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" returned: 0 in 0.705s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-2f04ee4b-610d-49e4-87bb-b7573f80fe1f" released by "delete_volume" :: held 1.635s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Created reservations ['1e446af4-6be2-4b23-b686-456c803588ee', 'cee7b7a7-793a-42e6-991d-393a5a4626fa', '3388c9d4-6d02-4b9f-8bdf-4b8bdb3c5540', 'a73b4409-eda8-433e-818c-70fd503ae513'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:42 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5" returned: 0 in 0.701s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.238s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:42 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:24:42 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Creating offline snapshot e775c842-2a8b-45a9-9c90-7508729dc28f of volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80aa72c-1c90-477f-890f-55295935cfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08bb971b-be96-40a2-8713-bbe3247c0cb5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6772d5c-d458-425a-8ce7-99eb046dd456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0167e26-2891-49eb-a6b8-fea0e5332fd1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Volume volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 (08bb971b-be96-40a2-8713-bbe3247c0cb5): created successfully Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6772d5c-d458-425a-8ce7-99eb046dd456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Flow 'volume_create_manager' (e054e72f-3f58-4ab8-969b-bee6624662ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-177a5825-1c6e-4f44-b63d-c8fd41afbc38 tempest-VolumesExtendTest-1452505900 None] Created volume successfully. Jul 05 05:24:42 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 Jul 05 05:24:42 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:43 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.673s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:24:43 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Deleted volume successfully. Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51c887a8-b60a-42e0-9804-e62f25d62cc1 tempest-VolumesGetTest-1759722072 None] Lock "cinder-2f04ee4b-610d-49e4-87bb-b7573f80fe1f-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:43 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9" returned: 0 in 0.835s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:43 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f 1G Jul 05 05:24:43 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (f2810b09-6603-4991-9306-ff0ce660a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7e9aac-e4b1-4c74-884e-2b8532feb960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7e9aac-e4b1-4c74-884e-2b8532feb960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2034848670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a896a044-7572-4bd2-990a-a5c602bd34c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:44Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1812d-0180-4135-a175-61dafc37c39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e1812d-0180-4135-a175-61dafc37c39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5163bc04-c9d2-4cb0-a5ab-2fab57ff9fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:24:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5163bc04-c9d2-4cb0-a5ab-2fab57ff9fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a896a044-7572-4bd2-990a-a5c602bd34c1', 'volume_name': 'volume-a896a044-7572-4bd2-990a-a5c602bd34c1', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28faab-608b-42b1-a8be-d25cbe288238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28faab-608b-42b1-a8be-d25cbe288238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec7094b-e8a7-4397-a380-4f6ff7d71449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:44 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Volume a896a044-7572-4bd2-990a-a5c602bd34c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a896a044-7572-4bd2-990a-a5c602bd34c1', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Trying to clone a896a044-7572-4bd2-990a-a5c602bd34c1 from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:24:44 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Image download 20.69 MB at 20.69 MB/s Jul 05 05:24:44 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f 1G" returned: 0 in 0.894s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:44 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f Jul 05 05:24:44 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e192d8f-1fba-479a-8e69-a121dc436900]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:44 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD Jul 05 05:24:44 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:45 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f" returned: 0 in 0.687s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:45 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f is being set with open permissions: ugo+rw Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:45 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f Jul 05 05:24:45 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:45 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e is fetched for user f6cc1ab9ba0741f9998104ca73d20a2b. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d11e6c-8d80-4cd0-9199-b3b8d75db834]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:45 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD Jul 05 05:24:45 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:45 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f" returned: 0 in 0.665s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.191s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.021s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Creating offline snapshot 8f98257a-d106-4339-b069-d74134606d69 of volume 08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:24:45 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-22f84dc9-a21e-4b09-825d-e19e6d0f7633 tempest-VolumesSnapshotListTestJSON-2028265522 None] Create snapshot completed successfully Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70148e7-3368-40ab-90a6-4f9fc15654b9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:45 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 Jul 05 05:24:45 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:46 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:46 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:46 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 1G Jul 05 05:24:46 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:47 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 1G" returned: 0 in 0.845s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:47 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 Jul 05 05:24:47 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:48 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69" returned: 0 in 0.673s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:48 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 is being set with open permissions: ugo+rw Jul 05 05:24:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:48 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 Jul 05 05:24:48 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:48 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69" returned: 0 in 0.631s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:48 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.info Jul 05 05:24:48 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:49 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.info" returned: 0 in 0.634s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:49 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.info is being set with open permissions: ugo+rw Jul 05 05:24:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:49 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.info Jul 05 05:24:49 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:50 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.info" returned: 0 in 0.651s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.305s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2034848670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a896a044-7572-4bd2-990a-a5c602bd34c1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:24:44Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Creating volume a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:24:50 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:50 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 1073741824 Jul 05 05:24:50 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a5d01e25-ef24-48fb-90f6-f06d2df7a17b tempest-VolumesExtendTest-1452505900 None] Create snapshot completed successfully Jul 05 05:24:50 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 1073741824" returned: 0 in 0.804s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:51 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 Jul 05 05:24:51 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:24:51 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1" returned: 0 in 0.635s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.819s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Creating offline snapshot dd040981-0b0e-4fdd-87de-deaa818fe611 of volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Attempting download of 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume a896a044-7572-4bd2-990a-a5c602bd34c1. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce68677-ad35-436d-913b-13d2035922d0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a403527-cfb7-4660-884f-c481fd2be912]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_xorv94tp {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:51 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f Jul 05 05:24:51 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:51 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_xorv94tp Jul 05 05:24:51 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:52 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:52 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_xorv94tp" returned: 0 in 0.732s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_xorv94tp {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f" returned: 0 in 0.790s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:24:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:52 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 1G Jul 05 05:24:52 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:52 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_xorv94tp Jul 05 05:24:52 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:53 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_xorv94tp" returned: 1 in 0.742s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_xorv94tp' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5727d4-0907-4161-a103-422d64539882]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:53 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD Jul 05 05:24:53 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:53 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 1G" returned: 0 in 0.882s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:53 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 Jul 05 05:24:53 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:53 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e was qcow2, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:24:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:54 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 Jul 05 05:24:54 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:54 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611" returned: 0 in 0.721s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:54 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 is being set with open permissions: ugo+rw Jul 05 05:24:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:54 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 Jul 05 05:24:54 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:54 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611" returned: 0 in 0.733s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.248s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.746s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:24:54 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda5b0d8-bb50-4e6d-9d51-2b28ca521a07]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-dad8b28b-ac54-4bf8-8ba0-bd7ac2b5ce22 tempest-VolumesSnapshotListTestJSON-2028265522 None] Create snapshot completed successfully Jul 05 05:24:55 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 Jul 05 05:24:55 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:55 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5" returned: 0 in 0.828s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 2G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 2G" returned: 0 in 0.164s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.044s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:24:55 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-2f50adf7-b9fc-4ff7-a0f5-81c87f8b4e11 tempest-VolumesExtendTest-1452505900 None] Extend volume completed successfully. Jul 05 05:24:56 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1" returned: 0 in 2.032s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3239ecd4-7b02-4de2-ac4a-d2ed92aef56e_2o25jgfsdevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:24:56 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Converted 112.00 MB image at 55.11 MB/s Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:56 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 1G Jul 05 05:24:56 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-dd040981-0b0e-4fdd-87de-deaa818fe611-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-dd040981-0b0e-4fdd-87de-deaa818fe611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-quobyte-dd040981-0b0e-4fdd-87de-deaa818fe611" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-dd040981-0b0e-4fdd-87de-deaa818fe611" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Deleting offline snapshot dd040981-0b0e-4fdd-87de-deaa818fe611 of volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] snapshot_file for this snap is: volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aed16c8-14ad-4221-8dd5-3358d794fba3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:56 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 Jul 05 05:24:56 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "cinder-8f98257a-d106-4339-b069-d74134606d69-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-8f98257a-d106-4339-b069-d74134606d69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "cinder-quobyte-08bb971b-be96-40a2-8713-bbe3247c0cb5" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:56 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 1G" returned: 0 in 0.710s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-08bb971b-be96-40a2-8713-bbe3247c0cb5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "cinder-quobyte-8f98257a-d106-4339-b069-d74134606d69" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-8f98257a-d106-4339-b069-d74134606d69" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Deleting offline snapshot 8f98257a-d106-4339-b069-d74134606d69 of volume 08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] snapshot_file for this snap is: volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[746cb571-1bdc-48f8-a045-714a1d47603b]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[178a45ec-c56d-43ff-b234-aa4c3bf81302]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:56 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 Jul 05 05:24:56 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:56 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 Jul 05 05:24:56 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:57 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611" returned: 0 in 0.849s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a912853c-e1d4-4009-9d57-8934b4f48281]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:57 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f Jul 05 05:24:57 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:57 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1" returned: 0 in 0.799s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:57 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69" returned: 0 in 0.813s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08bb971b-be96-40a2-8713-bbe3247c0cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[972940ec-8490-4ada-b021-c8e93c577665]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:57 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 Jul 05 05:24:57 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:57 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 Jul 05 05:24:57 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:57 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f" returned: 0 in 0.820s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:24:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:57 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 Jul 05 05:24:57 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:58 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1" returned: 1 in 0.811s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Downloaded image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e ((None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}])) to volume a896a044-7572-4bd2-990a-a5c602bd34c1 successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Temporary image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e for user f6cc1ab9ba0741f9998104ca73d20a2b is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Marking volume a896a044-7572-4bd2-990a-a5c602bd34c1 as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Copying metadata from image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e to a896a044-7572-4bd2-990a-a5c602bd34c1. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Creating volume glance metadata for volume a896a044-7572-4bd2-990a-a5c602bd34c1 backed by image 3239ecd4-7b02-4de2-ac4a-d2ed92aef56e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:24:58 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5" returned: 0 in 0.826s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:58 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 Jul 05 05:24:58 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec7094b-e8a7-4397-a380-4f6ff7d71449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a896a044-7572-4bd2-990a-a5c602bd34c1', 'volume_size': 1, 'image_id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbb27fa52d114642a0cc02f801ee3ff1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3239ecd4-7b02-4de2-ac4a-d2ed92aef56e', 'created_at': datetime.datetime(2026, 7, 5, 3, 3, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 3, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3239ecd4-7b02-4de2-ac4a-d2ed92aef56e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a624452-10fd-4172-8d33-f2d8ddbc39d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:24:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Volume volume-a896a044-7572-4bd2-990a-a5c602bd34c1 (a896a044-7572-4bd2-990a-a5c602bd34c1): created successfully Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a624452-10fd-4172-8d33-f2d8ddbc39d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (f2810b09-6603-4991-9306-ff0ce660a849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:24:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c080e269-7ad8-4908-a4ab-3a22f53d0763 tempest-VolumesGetTest-1759722072 None] Created volume successfully. Jul 05 05:24:58 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611" returned: 0 in 0.869s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:58 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611 Jul 05 05:24:58 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:59 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69" returned: 0 in 0.805s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:24:59 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69 Jul 05 05:24:59 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:24:59 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 05 05:24:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.dd040981-0b0e-4fdd-87de-deaa818fe611" returned: 0 in 0.675s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:24:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-dd040981-0b0e-4fdd-87de-deaa818fe611" released by "_delete_snapshot" :: held 3.312s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" released by "delete_snapshot" :: held 3.343s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:24:59 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Created reservations ['64c9f41a-5e4a-4115-aeeb-c9bf39bce9e4', '80bde9f2-82e8-4bb7-a3bf-d68b04b83330', 'fa2a64f2-6906-4f3d-ba6f-cafa3974f346', 'abee521e-ec89-4420-916b-f4f55fb1cbbb'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:24:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Delete snapshot completed successfully. Jul 05 05:24:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-52de7a1e-2a73-4ffc-9b29-871673c97e28 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-dd040981-0b0e-4fdd-87de-deaa818fe611-delete_snapshot" released by "delete_snapshot" :: held 3.514s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:00 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5.8f98257a-d106-4339-b069-d74134606d69" returned: 0 in 0.721s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-8f98257a-d106-4339-b069-d74134606d69" released by "_delete_snapshot" :: held 3.283s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-08bb971b-be96-40a2-8713-bbe3247c0cb5" released by "delete_snapshot" :: held 3.311s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Created reservations ['30234e43-75d7-4144-868b-3f13d1a5cc36', '7434dc1f-c497-4657-9025-caee3efeca2f', '2aa3b283-a527-4c27-b5f0-ca0601f8b382', '0c44e76d-b646-4b88-b0e2-235f1b704105'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Delete snapshot completed successfully. Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1fe35c2f-166d-4e4c-bfdf-671650e9abb8 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-8f98257a-d106-4339-b069-d74134606d69-delete_snapshot" released by "delete_snapshot" :: held 3.495s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-e775c842-2a8b-45a9-9c90-7508729dc28f-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-e775c842-2a8b-45a9-9c90-7508729dc28f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (1a0195a3-f5d4-4c27-a6aa-93204465f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbee79c-336d-42f3-b617-1e49f0294203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-quobyte-e775c842-2a8b-45a9-9c90-7508729dc28f" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbee79c-336d-42f3-b617-1e49f0294203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1020045222',display_name='tempest-VolumesGetTest-Volume-1222875330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db8de3b-7edf-4e97-b041-c4c8e783fbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:00Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45106e8f-da47-4e9c-ab55-213c5ad9b978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45106e8f-da47-4e9c-ab55-213c5ad9b978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab94947-733a-47aa-9359-fb588f675b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab94947-733a-47aa-9359-fb588f675b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db8de3b-7edf-4e97-b041-c4c8e783fbd4', 'volume_name': 'volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd841f04-e4dc-4fd3-8993-fafe1639cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd841f04-e4dc-4fd3-8993-fafe1639cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b7fac9-c4bd-4e98-920f-9b5cf575b610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:00 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Volume 9db8de3b-7edf-4e97-b041-c4c8e783fbd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4', 'volume_size': 1} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1020045222',display_name='tempest-VolumesGetTest-Volume-1222875330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db8de3b-7edf-4e97-b041-c4c8e783fbd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12ef587be534a17abdab6755a548e00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:00Z,use_quota=True,user_id='f6cc1ab9ba0741f9998104ca73d20a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Creating volume 9db8de3b-7edf-4e97-b041-c4c8e783fbd4 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:00 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-e775c842-2a8b-45a9-9c90-7508729dc28f" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Deleting offline snapshot e775c842-2a8b-45a9-9c90-7508729dc28f of volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:25:00 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 1073741824 Jul 05 05:25:00 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] snapshot_file for this snap is: volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa584821-9fbe-49e8-999d-5684ab878cc2]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:00 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f Jul 05 05:25:00 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "cinder-08bb971b-be96-40a2-8713-bbe3247c0cb5-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-08bb971b-be96-40a2-8713-bbe3247c0cb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "cinder-quobyte-08bb971b-be96-40a2-8713-bbe3247c0cb5" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-08bb971b-be96-40a2-8713-bbe3247c0cb5" acquired by "delete_volume" :: waited 0.031s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[474dd456-9750-43c5-85ca-36683f848264]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:01 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 Jul 05 05:25:01 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:01 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f" returned: 0 in 0.858s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:25:01 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 1073741824" returned: 0 in 0.934s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e675df-ade8-49d5-8eee-e6b4fc2031a6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:01 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 Jul 05 05:25:01 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:01 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 Jul 05 05:25:01 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:01 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5" returned: 0 in 0.841s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:01 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5 Jul 05 05:25:02 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:02 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4" returned: 0 in 0.755s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b7fac9-c4bd-4e98-920f-9b5cf575b610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff95474-65be-4a66-8580-a3fe64a8c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:02 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Volume volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 (9db8de3b-7edf-4e97-b041-c4c8e783fbd4): created successfully Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff95474-65be-4a66-8580-a3fe64a8c956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Flow 'volume_create_manager' (1a0195a3-f5d4-4c27-a6aa-93204465f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:02 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9" returned: 0 in 0.874s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e515d9b3-6e11-4894-8a81-3fe963003540 tempest-VolumesGetTest-1759722072 None] Created volume successfully. Jul 05 05:25:02 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f Jul 05 05:25:02 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-9db8de3b-7edf-4e97-b041-c4c8e783fbd4-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Lock "cinder-9db8de3b-7edf-4e97-b041-c4c8e783fbd4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:02 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-08bb971b-be96-40a2-8713-bbe3247c0cb5" returned: 0 in 0.699s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-quobyte-08bb971b-be96-40a2-8713-bbe3247c0cb5" released by "delete_volume" :: held 1.609s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-9db8de3b-7edf-4e97-b041-c4c8e783fbd4" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-9db8de3b-7edf-4e97-b041-c4c8e783fbd4" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc5313e-6337-496b-a3be-bb382cce3b02]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Created reservations ['81b8b06f-b7ad-4373-b36b-57adc6357b05', 'b964c3ce-5892-4b0f-a07f-abe5ca47a0b1', '2b4cb277-9ca2-41d2-af7d-e067fa9ce091', '1a8b18ff-ce32-4926-8a8d-5442207061ea'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:02 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:02 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:02 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 Jul 05 05:25:02 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:03 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f" returned: 0 in 0.838s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:03 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f Jul 05 05:25:03 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:03 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Deleted volume successfully. Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e518b0c-5e1d-4f3f-8dd9-599510dfc0b9 tempest-VolumesExtendTest-1452505900 None] Lock "cinder-08bb971b-be96-40a2-8713-bbe3247c0cb5-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:03 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4" returned: 0 in 0.941s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:03 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4 Jul 05 05:25:03 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:03 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.e775c842-2a8b-45a9-9c90-7508729dc28f" returned: 0 in 0.787s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-e775c842-2a8b-45a9-9c90-7508729dc28f" released by "_delete_snapshot" :: held 3.475s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" released by "delete_snapshot" :: held 3.562s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Created reservations ['74f1f8db-b5b5-435d-9e79-379ae41ad319', 'd88a69b3-3f53-45c3-b255-517cc1d0c1df', '023dc706-926b-48b8-a33d-7fbb869f19d2', 'c1dc888c-b8d3-4a4a-8afa-0b0a4f97375f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Delete snapshot completed successfully. Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4316cca-59d5-4537-80ae-04b2ddf94aa4 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-e775c842-2a8b-45a9-9c90-7508729dc28f-delete_snapshot" released by "delete_snapshot" :: held 3.785s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:04 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9db8de3b-7edf-4e97-b041-c4c8e783fbd4" returned: 0 in 0.707s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-9db8de3b-7edf-4e97-b041-c4c8e783fbd4" released by "delete_volume" :: held 1.690s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Created reservations ['8b154d3b-f0d3-4e1d-acce-d45b07bbc47c', 'ec591638-5265-4ff4-9283-35236e385147', '3a70a1cb-2ec7-4510-aabd-dba93b141ca3', '701d731e-24b2-4041-b696-53f2efaa3d86'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:04 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:04 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-f30e9342-20df-4bb1-b1ea-f3faad6931e9-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-f30e9342-20df-4bb1-b1ea-f3faad6931e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-quobyte-f30e9342-20df-4bb1-b1ea-f3faad6931e9" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-f30e9342-20df-4bb1-b1ea-f3faad6931e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Deleting offline snapshot f30e9342-20df-4bb1-b1ea-f3faad6931e9 of volume 9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] snapshot_file for this snap is: volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7751533-5fd5-453c-b882-935f6c3ce306]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:04 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 Jul 05 05:25:04 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-a896a044-7572-4bd2-990a-a5c602bd34c1-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Lock "cinder-a896a044-7572-4bd2-990a-a5c602bd34c1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Acquiring lock "cinder-quobyte-a896a044-7572-4bd2-990a-a5c602bd34c1" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-a896a044-7572-4bd2-990a-a5c602bd34c1" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff947848-eafd-40b0-9a20-8c6d766c9287]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:05 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 Jul 05 05:25:05 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:05 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.851s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:05 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Deleted volume successfully. Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-73082a55-a569-49d5-9288-602bc5487b74 tempest-VolumesGetTest-1759722072 None] Lock "cinder-9db8de3b-7edf-4e97-b041-c4c8e783fbd4-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:05 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9" returned: 0 in 0.937s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1a2fc-b5cc-46f2-8fe2-5392ea3be0e5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:05 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e Jul 05 05:25:05 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:05 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1" returned: 0 in 0.835s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:06 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 Jul 05 05:25:06 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:06 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:06 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 Jul 05 05:25:06 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Flow 'volume_create_manager' (025aa31a-629b-441c-ae06-9acb26ddafea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed412212-f078-4247-be9d-b6f3c64afa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed412212-f078-4247-be9d-b6f3c64afa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2059619163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b860f361-7a27-4e55-b351-bdd61c8d1104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aad58b8ce6e4a20a631eb4eae6775d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:07Z,use_quota=True,user_id='ea5d1687efd74aafbb738ba501d60d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62da9d5b-8ff9-498e-b233-b31619122935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62da9d5b-8ff9-498e-b233-b31619122935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795cbc66-2a1e-425e-a3f2-adb75d1be8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795cbc66-2a1e-425e-a3f2-adb75d1be8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b860f361-7a27-4e55-b351-bdd61c8d1104', 'volume_name': 'volume-b860f361-7a27-4e55-b351-bdd61c8d1104', 'volume_size': 2}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:06 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f876484-c9a7-412e-b76a-d47b5e2e37fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f876484-c9a7-412e-b76a-d47b5e2e37fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2fd184-9bc9-42f5-a2d7-776062d4c826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Volume b860f361-7a27-4e55-b351-bdd61c8d1104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b860f361-7a27-4e55-b351-bdd61c8d1104', 'volume_size': 2} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2059619163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b860f361-7a27-4e55-b351-bdd61c8d1104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aad58b8ce6e4a20a631eb4eae6775d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:07Z,use_quota=True,user_id='ea5d1687efd74aafbb738ba501d60d83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Creating volume b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:06 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 2147483648 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1" returned: 1 in 0.864s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:25:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:06 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 2147483648 Jul 05 05:25:06 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:06 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1 Jul 05 05:25:06 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:07 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9" returned: 0 in 0.784s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:07 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9 Jul 05 05:25:07 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:07 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a896a044-7572-4bd2-990a-a5c602bd34c1" returned: 0 in 0.707s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Lock "cinder-quobyte-a896a044-7572-4bd2-990a-a5c602bd34c1" released by "delete_volume" :: held 2.481s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=118,cinder:INSERT=49,cinder:UPDATE=132,cinder:DELETE=11 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=105,cinder:INSERT=39,cinder:UPDATE=132,cinder:DELETE=12 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Created reservations ['88ce6d89-2613-416b-8f21-b428ed6426ca', 'f25583d2-6c50-4133-8f01-37a66344998b', '18ae52f0-e7ab-457b-a2d0-4c3fc390615a', '3667819e-8fbd-4d8a-b499-50891d2c4c1a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:07 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:07 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:07 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 2147483648" returned: 0 in 1.031s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:07 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 Jul 05 05:25:07 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:08 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e.f30e9342-20df-4bb1-b1ea-f3faad6931e9" returned: 0 in 0.715s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-f30e9342-20df-4bb1-b1ea-f3faad6931e9" released by "_delete_snapshot" :: held 3.436s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" released by "delete_snapshot" :: held 3.462s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Created reservations ['3741e871-0c87-452a-bd59-292f16f06c36', '9068b43c-c9a3-4166-ac0a-ac4506cfd624', 'a5058558-bd64-4011-bde2-398479d716e2', 'd07655d2-6f0d-4f83-bd8b-2408c8ff154f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Delete snapshot completed successfully. Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-97fffa35-8cdf-4722-a5d8-eff50de04a7b tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-f30e9342-20df-4bb1-b1ea-f3faad6931e9-delete_snapshot" released by "delete_snapshot" :: held 3.614s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:08 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.751s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Deleted volume successfully. Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-c35befca-f562-4a91-b47b-55c142ea4dc8 tempest-VolumesGetTest-1759722072 None] Lock "cinder-a896a044-7572-4bd2-990a-a5c602bd34c1-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:08 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104" returned: 0 in 0.706s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2fd184-9bc9-42f5-a2d7-776062d4c826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b860f361-7a27-4e55-b351-bdd61c8d1104', 'volume_size': 2}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ccc0bb-307a-4f01-a121-71e1c0628008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:08 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Volume volume-b860f361-7a27-4e55-b351-bdd61c8d1104 (b860f361-7a27-4e55-b351-bdd61c8d1104): created successfully Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ccc0bb-307a-4f01-a121-71e1c0628008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Flow 'volume_create_manager' (025aa31a-629b-441c-ae06-9acb26ddafea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-15dd1500-8318-4f59-8e51-0ccb2ed01ae2 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Created volume successfully. Jul 05 05:25:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-9522806b-cbfc-44c3-ae2d-66a3dea5d17e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-9522806b-cbfc-44c3-ae2d-66a3dea5d17e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Creating offline snapshot 797b9639-8e10-413d-8757-4c623663168b of volume b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ce202a-f579-47b1-86fc-c2d612c2a16c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9204c5a3-fc49-489c-98eb-e92f0594ff6d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:09 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 Jul 05 05:25:09 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:09 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e Jul 05 05:25:09 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:10 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104" returned: 0 in 0.830s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b 2G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:10 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" returned: 0 in 0.832s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:10 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b 2G Jul 05 05:25:10 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:10 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e Jul 05 05:25:10 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:10 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" returned: 0 in 0.707s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-quobyte-9522806b-cbfc-44c3-ae2d-66a3dea5d17e" released by "delete_volume" :: held 1.635s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Created reservations ['501d844e-cdd9-4920-a370-90fa5058482d', 'd2deed5e-eab5-4dc4-9763-2bbb83a3b665', '3a7a62a8-a687-4df1-ad50-393463f0672d', 'feb13984-351b-4728-92d1-a7745c0a8b70'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:10 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b 2G" returned: 0 in 0.857s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b860f361-7a27-4e55-b351-bdd61c8d1104 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:10 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b860f361-7a27-4e55-b351-bdd61c8d1104 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b Jul 05 05:25:10 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:10 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:10 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Flow 'volume_create_manager' (b6982b58-19ba-42e1-829d-6db3528513ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ee180-6489-43d8-a3cb-e835b0a19830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a95ee180-6489-43d8-a3cb-e835b0a19830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1094773027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe5c908-1d6d-41ca-86ef-44272d36d6f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6502bb6f54244209e86705a21c2fc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:12Z,use_quota=True,user_id='fd6ed18e1b1342a5934070a0c1b01a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:11 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f195ee-867a-46f3-87b4-5e164951a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f195ee-867a-46f3-87b4-5e164951a89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ec6bd-212d-4aa6-b140-7dbafa0cb3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253ec6bd-212d-4aa6-b140-7dbafa0cb3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe5c908-1d6d-41ca-86ef-44272d36d6f9', 'volume_name': 'volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb78e2a2-501f-49e3-a31b-428c6edc6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb78e2a2-501f-49e3-a31b-428c6edc6545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f968086-7695-44e4-b01b-1be514a23e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Volume 9fe5c908-1d6d-41ca-86ef-44272d36d6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9', 'volume_size': 1} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b860f361-7a27-4e55-b351-bdd61c8d1104 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b" returned: 0 in 0.829s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:11 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b is being set with open permissions: ugo+rw Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:11 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b Jul 05 05:25:11 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:11 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.816s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Deleted volume successfully. Jul 05 05:25:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9b132b30-349a-4d72-85f8-d84ccdadddb2 tempest-VolumesSnapshotListTestJSON-2028265522 None] Lock "cinder-9522806b-cbfc-44c3-ae2d-66a3dea5d17e-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:12 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b" returned: 0 in 0.757s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:12 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.info Jul 05 05:25:12 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:13 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.info" returned: 0 in 0.706s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:13 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.info is being set with open permissions: ugo+rw Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:13 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.info Jul 05 05:25:13 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:13 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.info" returned: 0 in 0.659s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.178s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1094773027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe5c908-1d6d-41ca-86ef-44272d36d6f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6502bb6f54244209e86705a21c2fc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:12Z,use_quota=True,user_id='fd6ed18e1b1342a5934070a0c1b01a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Creating volume 9fe5c908-1d6d-41ca-86ef-44272d36d6f9 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:13 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:13 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 1073741824 Jul 05 05:25:13 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-741f177f-4ced-4251-918a-d72933e46049 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Create snapshot completed successfully Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "cinder-797b9639-8e10-413d-8757-4c623663168b-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-797b9639-8e10-413d-8757-4c623663168b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "cinder-quobyte-b860f361-7a27-4e55-b351-bdd61c8d1104" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-quobyte-b860f361-7a27-4e55-b351-bdd61c8d1104" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "cinder-quobyte-797b9639-8e10-413d-8757-4c623663168b" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-quobyte-797b9639-8e10-413d-8757-4c623663168b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Deleting offline snapshot 797b9639-8e10-413d-8757-4c623663168b of volume b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] snapshot_file for this snap is: volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[be06c21e-da34-4a6f-83de-1571692ad8cb]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:14 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b Jul 05 05:25:14 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:14 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 1073741824" returned: 0 in 0.919s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:14 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 Jul 05 05:25:14 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:15 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b" returned: 0 in 0.841s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b860f361-7a27-4e55-b351-bdd61c8d1104(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac15891-9c06-407c-9de2-1eab2a7fc17a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:15 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:15 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 Jul 05 05:25:15 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9" returned: 0 in 0.740s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f968086-7695-44e4-b01b-1be514a23e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7355a6c0-fd11-42db-b0d9-24c9cbda2a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:15 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Volume volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 (9fe5c908-1d6d-41ca-86ef-44272d36d6f9): created successfully Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7355a6c0-fd11-42db-b0d9-24c9cbda2a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Flow 'volume_create_manager' (b6982b58-19ba-42e1-829d-6db3528513ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bf53f2ae-b3c3-4542-9fd6-f058846d1e2b tempest-VolumesListTestJSON-576065068 None] Created volume successfully. Jul 05 05:25:16 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104" returned: 0 in 0.805s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:16 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b Jul 05 05:25:16 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:17 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b" returned: 0 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:17 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b Jul 05 05:25:17 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Flow 'volume_create_manager' (3c9d1536-1857-45a3-a9aa-074813e8e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6701acf-1877-4bd1-b04c-0da49f0f1731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6701acf-1877-4bd1-b04c-0da49f0f1731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1374905450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c809e5-c67d-4459-bde8-1442d7377384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6502bb6f54244209e86705a21c2fc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:17Z,use_quota=True,user_id='fd6ed18e1b1342a5934070a0c1b01a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9aadd71-ff87-4440-97d9-33547ee0306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9aadd71-ff87-4440-97d9-33547ee0306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495fadf4-e634-462a-9550-e6a9bbd47405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (495fadf4-e634-462a-9550-e6a9bbd47405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c809e5-c67d-4459-bde8-1442d7377384', 'volume_name': 'volume-93c809e5-c67d-4459-bde8-1442d7377384', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c1957-c60a-4ccf-9026-d35c3108d65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933c1957-c60a-4ccf-9026-d35c3108d65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2e9eca-20cd-4e04-b655-03c3a24e9b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:17 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Volume 93c809e5-c67d-4459-bde8-1442d7377384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c809e5-c67d-4459-bde8-1442d7377384', 'volume_size': 1} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1374905450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c809e5-c67d-4459-bde8-1442d7377384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6502bb6f54244209e86705a21c2fc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:17Z,use_quota=True,user_id='fd6ed18e1b1342a5934070a0c1b01a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Creating volume 93c809e5-c67d-4459-bde8-1442d7377384 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:17 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:17 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 1073741824 Jul 05 05:25:17 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:17 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104.797b9639-8e10-413d-8757-4c623663168b" returned: 0 in 0.784s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-quobyte-797b9639-8e10-413d-8757-4c623663168b" released by "_delete_snapshot" :: held 3.379s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-quobyte-b860f361-7a27-4e55-b351-bdd61c8d1104" released by "delete_snapshot" :: held 3.407s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:17 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Created reservations ['b4979470-c3f5-4c4c-b570-7c80bd6f886f', 'eca7618c-b84d-44c4-9d6a-53673c14502c', '31749984-dabc-4da1-b1e0-9f422cfc477f', '15e5c91b-80a6-43db-9744-7508d457bed1'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Delete snapshot completed successfully. Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53236cac-bde8-460c-8bb7-aa918c64804b tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-797b9639-8e10-413d-8757-4c623663168b-delete_snapshot" released by "delete_snapshot" :: held 3.587s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:18 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 1073741824" returned: 0 in 1.059s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:18 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 Jul 05 05:25:18 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "cinder-b860f361-7a27-4e55-b351-bdd61c8d1104-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-b860f361-7a27-4e55-b351-bdd61c8d1104-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "cinder-quobyte-b860f361-7a27-4e55-b351-bdd61c8d1104" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-quobyte-b860f361-7a27-4e55-b351-bdd61c8d1104" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6790e9-621b-462b-aa4d-24a82429a85c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:19 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 Jul 05 05:25:19 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:19 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384" returned: 0 in 0.781s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2e9eca-20cd-4e04-b655-03c3a24e9b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c809e5-c67d-4459-bde8-1442d7377384', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365b4483-089a-41b6-871c-12079fe04b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Volume volume-93c809e5-c67d-4459-bde8-1442d7377384 (93c809e5-c67d-4459-bde8-1442d7377384): created successfully Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365b4483-089a-41b6-871c-12079fe04b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Flow 'volume_create_manager' (3c9d1536-1857-45a3-a9aa-074813e8e488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b10f1241-bf64-4079-b168-6f1b5249a5ed tempest-VolumesListTestJSON-576065068 None] Created volume successfully. Jul 05 05:25:19 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104" returned: 0 in 0.854s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:19 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104 Jul 05 05:25:19 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:20 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b860f361-7a27-4e55-b351-bdd61c8d1104" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-quobyte-b860f361-7a27-4e55-b351-bdd61c8d1104" released by "delete_volume" :: held 1.588s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Created reservations ['4ef3eae6-9763-4cdf-9a96-efeef1f9c894', 'e685347f-6872-4fda-a70b-763578a6ca71', '3eab63b7-0bca-42ac-86f1-d7076dd516e9', '111d31f1-2cc3-4292-baf2-64815cf91fa4'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:20 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:20 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Flow 'volume_create_manager' (f735e88a-9e3f-4397-9827-bcf2ad57f398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53f5fa4-b912-451f-97af-e45a7e89afda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53f5fa4-b912-451f-97af-e45a7e89afda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1400672623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1a7628-3221-43ce-b231-940a2ce70f2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6502bb6f54244209e86705a21c2fc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:21Z,use_quota=True,user_id='fd6ed18e1b1342a5934070a0c1b01a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01c98b6-fa7c-47ea-85ba-980ed7528359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01c98b6-fa7c-47ea-85ba-980ed7528359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc8e86e-c4d0-4416-af9d-4a00ad6eef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc8e86e-c4d0-4416-af9d-4a00ad6eef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1a7628-3221-43ce-b231-940a2ce70f2f', 'volume_name': 'volume-ab1a7628-3221-43ce-b231-940a2ce70f2f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e2162e-a6f6-4d17-b674-09d62a3c4fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e2162e-a6f6-4d17-b674-09d62a3c4fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc74ecdf-8ea5-4fd6-8786-e481d0b56845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Volume ab1a7628-3221-43ce-b231-940a2ce70f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1a7628-3221-43ce-b231-940a2ce70f2f', 'volume_size': 1} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1400672623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1a7628-3221-43ce-b231-940a2ce70f2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6502bb6f54244209e86705a21c2fc09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:21Z,use_quota=True,user_id='fd6ed18e1b1342a5934070a0c1b01a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Creating volume ab1a7628-3221-43ce-b231-940a2ce70f2f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:21 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:21 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.049s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:21 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f 1073741824 Jul 05 05:25:21 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Deleted volume successfully. Jul 05 05:25:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6117e235-a3d4-4cc3-bfe7-a3d2bab69cc5 tempest-VolumesSnapshotNegativeTestJSON-1918795213 None] Lock "cinder-b860f361-7a27-4e55-b351-bdd61c8d1104-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:22 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f 1073741824" returned: 0 in 1.119s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:22 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f Jul 05 05:25:22 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:23 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f" returned: 0 in 0.939s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc74ecdf-8ea5-4fd6-8786-e481d0b56845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1a7628-3221-43ce-b231-940a2ce70f2f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fa4f96-cc40-4f4d-a201-4255061126f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Volume volume-ab1a7628-3221-43ce-b231-940a2ce70f2f (ab1a7628-3221-43ce-b231-940a2ce70f2f): created successfully Jul 05 05:25:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fa4f96-cc40-4f4d-a201-4255061126f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Flow 'volume_create_manager' (f735e88a-9e3f-4397-9827-bcf2ad57f398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fdd59e41-c4f3-40ec-a00d-844388946bda tempest-VolumesListTestJSON-576065068 None] Created volume successfully. Jul 05 05:25:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Acquiring lock "cinder-ab1a7628-3221-43ce-b231-940a2ce70f2f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Lock "cinder-ab1a7628-3221-43ce-b231-940a2ce70f2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Acquiring lock "cinder-quobyte-ab1a7628-3221-43ce-b231-940a2ce70f2f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Lock "cinder-quobyte-ab1a7628-3221-43ce-b231-940a2ce70f2f" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:27 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b6d4c-200a-458d-be85-e686e8d710cc]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:27 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f Jul 05 05:25:27 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:28 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f" returned: 0 in 0.885s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:28 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f Jul 05 05:25:28 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:29 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ab1a7628-3221-43ce-b231-940a2ce70f2f" returned: 0 in 0.702s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Lock "cinder-quobyte-ab1a7628-3221-43ce-b231-940a2ce70f2f" released by "delete_volume" :: held 1.643s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Created reservations ['6d8300fb-449f-4067-9416-693df91846eb', 'e0939ba1-d69c-467a-8019-4c926c35687a', '1e8d85ed-f750-4a07-844c-c20bd601cf91', 'd5d78d67-43bf-4162-bd42-21a765a08597'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:29 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:29 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Acquiring lock "cinder-93c809e5-c67d-4459-bde8-1442d7377384-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Lock "cinder-93c809e5-c67d-4459-bde8-1442d7377384-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Acquiring lock "cinder-quobyte-93c809e5-c67d-4459-bde8-1442d7377384" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Lock "cinder-quobyte-93c809e5-c67d-4459-bde8-1442d7377384" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b707ad27-7869-4cce-adbd-f8c0b0d6628b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:30 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.824s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Deleted volume successfully. Jul 05 05:25:30 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 Jul 05 05:25:30 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1b32dc27-4801-4eb4-86da-4f3693477273 tempest-VolumesListTestJSON-576065068 None] Lock "cinder-ab1a7628-3221-43ce-b231-940a2ce70f2f-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:30 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:30 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:31 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384" returned: 0 in 1.282s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:31 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384 Jul 05 05:25:31 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:31 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.078s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:25:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:25:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:25:32 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93c809e5-c67d-4459-bde8-1442d7377384" returned: 0 in 0.894s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Lock "cinder-quobyte-93c809e5-c67d-4459-bde8-1442d7377384" released by "delete_volume" :: held 2.241s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Created reservations ['52496bd6-6bd0-488a-b3a7-b60c9497fff8', 'fd96c343-9f7a-4642-aac6-9b026af4eee7', 'e5db8dee-b5c2-4ba6-9fdc-703b973f5cfa', '387319a5-a294-499a-8a0c-4e8b0b4f8c07'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:32 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:32 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:32 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.760s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Deleted volume successfully. Jul 05 05:25:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-330bd2ec-ceab-4ab6-8339-693fce3de1ab tempest-VolumesListTestJSON-576065068 None] Lock "cinder-93c809e5-c67d-4459-bde8-1442d7377384-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Acquiring lock "cinder-9fe5c908-1d6d-41ca-86ef-44272d36d6f9-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Lock "cinder-9fe5c908-1d6d-41ca-86ef-44272d36d6f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Acquiring lock "cinder-quobyte-9fe5c908-1d6d-41ca-86ef-44272d36d6f9" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:25:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Lock "cinder-quobyte-9fe5c908-1d6d-41ca-86ef-44272d36d6f9" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:25:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd2760-34d0-4a9b-899d-8bd78b66bce3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:33 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 Jul 05 05:25:33 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:34 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9" returned: 0 in 1.018s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:34 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9 Jul 05 05:25:34 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:35 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9fe5c908-1d6d-41ca-86ef-44272d36d6f9" returned: 0 in 0.762s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Lock "cinder-quobyte-9fe5c908-1d6d-41ca-86ef-44272d36d6f9" released by "delete_volume" :: held 1.846s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Created reservations ['c28d1d17-25b7-4e7b-be3e-fb935f59c22f', 'd9ee366f-8777-4956-9b47-0fa677a4936a', '09fc4f4e-2272-48f9-ba8e-8bddd27d37cc', '69d0d1e3-c727-49ba-83e9-d501d0ee27cd'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:35 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:25:35 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:36 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.892s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:36 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:25:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Deleted volume successfully. Jul 05 05:25:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b558e098-f00e-4ed8-bdb0-1675d4488ccb tempest-VolumesListTestJSON-576065068 None] Lock "cinder-9fe5c908-1d6d-41ca-86ef-44272d36d6f9-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Flow 'volume_create_manager' (da912ed3-ba2b-4ef4-a3da-1e29549b2ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63212b2c-5c9e-4fa7-967f-f2ed3741c158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63212b2c-5c9e-4fa7-967f-f2ed3741c158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-758660070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345c5d04-80dc-4a70-95ed-1f41d3dd792f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2799cf01f4234d6ca732f05ac91183a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:40Z,use_quota=True,user_id='2a5ad72fb4544fa481db2776019cad61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599d302f-33e1-4396-8e88-3d8371aca5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599d302f-33e1-4396-8e88-3d8371aca5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d959d3fc-1ad1-4c96-a0d4-3ee72622193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d959d3fc-1ad1-4c96-a0d4-3ee72622193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '345c5d04-80dc-4a70-95ed-1f41d3dd792f', 'volume_name': 'volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0d1b86-5eaf-468f-9ffb-b40bf1a0db6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0d1b86-5eaf-468f-9ffb-b40bf1a0db6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4739aeb6-3f54-49e5-9747-39afa727a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:40 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Volume 345c5d04-80dc-4a70-95ed-1f41d3dd792f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f', 'volume_size': 1} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-758660070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=345c5d04-80dc-4a70-95ed-1f41d3dd792f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2799cf01f4234d6ca732f05ac91183a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:40Z,use_quota=True,user_id='2a5ad72fb4544fa481db2776019cad61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Creating volume 345c5d04-80dc-4a70-95ed-1f41d3dd792f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:40 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:40 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f 1073741824 Jul 05 05:25:40 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Flow 'volume_create_manager' (b1964e26-169a-487c-a90b-14a84af3fd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e625217-cde3-4608-8c48-ea4ffcb7984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e625217-cde3-4608-8c48-ea4ffcb7984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-314080426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd24bb96-eafb-4db8-a811-25d85c0e2f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274cbe5b840467ba095cc4de2ce3d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:41Z,use_quota=True,user_id='8c5874bba1f2452dac7ba6a4543c192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33fe8297-d533-4848-9034-b05046437798),volume_type_id=33fe8297-d533-4848-9034-b05046437798)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19b92e3-1c44-4c1d-ba44-903b9e1c813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19b92e3-1c44-4c1d-ba44-903b9e1c813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bd3540-1674-47b8-ba48-d129491f8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3bd3540-1674-47b8-ba48-d129491f8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd24bb96-eafb-4db8-a811-25d85c0e2f81', 'volume_name': 'volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3ce3d6-5db3-4350-bb61-6aa73e79f1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a3ce3d6-5db3-4350-bb61-6aa73e79f1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5da0de-f091-495b-ab95-3b102946d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume cd24bb96-eafb-4db8-a811-25d85c0e2f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81', 'volume_size': 1} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:41 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f 1073741824" returned: 0 in 1.304s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:41 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f Jul 05 05:25:41 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Flow 'volume_create_manager' (9f20d784-e861-411e-94a5-581a800a8a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4b8ea1-920f-4af4-b5e4-8282b30d203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4b8ea1-920f-4af4-b5e4-8282b30d203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1514848194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e46e062-ceab-47ff-aa68-137ed0206fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274cbe5b840467ba095cc4de2ce3d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:42Z,use_quota=True,user_id='8c5874bba1f2452dac7ba6a4543c192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e27e043-824f-480d-9a1a-62d3a5d00ca1),volume_type_id=5e27e043-824f-480d-9a1a-62d3a5d00ca1)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1b9398-7609-4cd8-bd14-a40f5ff58b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1b9398-7609-4cd8-bd14-a40f5ff58b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6a3aa-b465-49a1-b6ee-f280aae7852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd6a3aa-b465-49a1-b6ee-f280aae7852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e46e062-ceab-47ff-aa68-137ed0206fe5', 'volume_name': 'volume-1e46e062-ceab-47ff-aa68-137ed0206fe5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeefdce-185a-46b6-9f7b-7064b171131a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfeefdce-185a-46b6-9f7b-7064b171131a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4ff4dd-ebcb-4692-9390-c412eb67eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume 1e46e062-ceab-47ff-aa68-137ed0206fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e46e062-ceab-47ff-aa68-137ed0206fe5', 'volume_size': 1} Jul 05 05:25:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:42 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f" returned: 0 in 0.742s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-314080426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd24bb96-eafb-4db8-a811-25d85c0e2f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274cbe5b840467ba095cc4de2ce3d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:41Z,use_quota=True,user_id='8c5874bba1f2452dac7ba6a4543c192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33fe8297-d533-4848-9034-b05046437798),volume_type_id=33fe8297-d533-4848-9034-b05046437798)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Creating volume cd24bb96-eafb-4db8-a811-25d85c0e2f81 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:42 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:42 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 1073741824 Jul 05 05:25:42 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4739aeb6-3f54-49e5-9747-39afa727a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0efb38-b535-4427-9d66-42b1d189ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Flow 'volume_create_manager' (93ad33d1-9331-4b88-a44d-02895fa91262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e82745-7293-4018-ba96-f1cdab431af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Volume volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f (345c5d04-80dc-4a70-95ed-1f41d3dd792f): created successfully Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0efb38-b535-4427-9d66-42b1d189ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Flow 'volume_create_manager' (da912ed3-ba2b-4ef4-a3da-1e29549b2ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e82745-7293-4018-ba96-f1cdab431af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1069009310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274cbe5b840467ba095cc4de2ce3d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:42Z,use_quota=True,user_id='8c5874bba1f2452dac7ba6a4543c192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dac14a41-ecd3-44ee-81a5-f4518a04ae1d),volume_type_id=dac14a41-ecd3-44ee-81a5-f4518a04ae1d)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36283ea-226d-4be5-9318-3fd3bcada055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36283ea-226d-4be5-9318-3fd3bcada055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2418d81c-29b5-4216-810d-a35f91d208f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:25:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-62cae40e-a3db-4e28-9433-149b21083b94 tempest-VolumesNegativeTest-370358477 None] Created volume successfully. Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2418d81c-29b5-4216-810d-a35f91d208f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b', 'volume_name': 'volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b', 'volume_size': 1, 'image_id': 'a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--887711013', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd274cbe5b840467ba095cc4de2ce3d3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'created_at': datetime.datetime(2026, 7, 5, 3, 25, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 25, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc/file', 'properties': {}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16ad0e1-0904-494d-a80f-510a5a0a720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16ad0e1-0904-494d-a80f-510a5a0a720d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b892bd-3dfc-4343-9a30-8db4efb90ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b', 'volume_size': 1, 'image_id': 'a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--887711013', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd274cbe5b840467ba095cc4de2ce3d3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'created_at': datetime.datetime(2026, 7, 5, 3, 25, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 25, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc/file', 'properties': {}}, 'image_service': } Jul 05 05:25:42 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Trying to clone 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b from image a6f0222a-7d4a-45b3-a840-1e310c1a67bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:25:43 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 1073741824" returned: 0 in 0.958s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:43 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 Jul 05 05:25:43 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:44 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81" returned: 0 in 0.848s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.426s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1514848194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e46e062-ceab-47ff-aa68-137ed0206fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274cbe5b840467ba095cc4de2ce3d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:42Z,use_quota=True,user_id='8c5874bba1f2452dac7ba6a4543c192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e27e043-824f-480d-9a1a-62d3a5d00ca1),volume_type_id=5e27e043-824f-480d-9a1a-62d3a5d00ca1)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Creating volume 1e46e062-ceab-47ff-aa68-137ed0206fe5 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:44 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5da0de-f091-495b-ab95-3b102946d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:44 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 1073741824 Jul 05 05:25:44 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073fc76c-fec0-4772-b2f7-3be225f6bfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:44 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 (cd24bb96-eafb-4db8-a811-25d85c0e2f81): created successfully Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073fc76c-fec0-4772-b2f7-3be225f6bfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Flow 'volume_create_manager' (b1964e26-169a-487c-a90b-14a84af3fd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-cf17ec4e-78d5-42de-ace2-abc1cba87f41 tempest-TestInstancesWithCinderVolumes-1265216336 None] Created volume successfully. Jul 05 05:25:45 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 1073741824" returned: 0 in 1.100s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:45 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 Jul 05 05:25:45 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:46 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5" returned: 0 in 0.967s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4ff4dd-ebcb-4692-9390-c412eb67eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e46e062-ceab-47ff-aa68-137ed0206fe5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef57f4dc-6c53-4e24-87ae-9eba071f6cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:46 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 (1e46e062-ceab-47ff-aa68-137ed0206fe5): created successfully Jul 05 05:25:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef57f4dc-6c53-4e24-87ae-9eba071f6cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Flow 'volume_create_manager' (9f20d784-e861-411e-94a5-581a800a8a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7506d22d-5d7b-4d4f-9b0a-778f21380d3b tempest-TestInstancesWithCinderVolumes-1265216336 None] Created volume successfully. Jul 05 05:25:47 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD, size 20.69 MB, duration 4.28 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:25:47 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Image download 20.69 MB at 4.84 MB/s Jul 05 05:25:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3e4d4c-2900-4d46-9013-ca1ccf884342]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:47 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD Jul 05 05:25:47 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:48 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD" returned: 0 in 0.823s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:48 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Temporary image a6f0222a-7d4a-45b3-a840-1e310c1a67bc is fetched for user 8c5874bba1f2452dac7ba6a4543c192d. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:25:48 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8e24aa-cdfa-4fab-adf1-7a2d24d40600]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:48 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD Jul 05 05:25:48 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:48 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD" returned: 0 in 0.834s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1069009310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274cbe5b840467ba095cc4de2ce3d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:25:42Z,use_quota=True,user_id='8c5874bba1f2452dac7ba6a4543c192d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dac14a41-ecd3-44ee-81a5-f4518a04ae1d),volume_type_id=dac14a41-ecd3-44ee-81a5-f4518a04ae1d)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Creating volume 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:25:49 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:49 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b 1073741824 Jul 05 05:25:49 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:49 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b 1073741824" returned: 0 in 0.941s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:50 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:25:50 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:50 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 0 in 0.948s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:25:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:25:50 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Attempting download of a6f0222a-7d4a-45b3-a840-1e310c1a67bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'metadata': {}}])) to volume 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:25:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8312deb-0e90-4478-b829-d205166b7719]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_qx_649pt {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:51 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_qx_649pt Jul 05 05:25:51 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:51 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_qx_649pt" returned: 0 in 0.876s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_qx_649pt {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:52 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_qx_649pt Jul 05 05:25:52 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:52 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_qx_649pt" returned: 1 in 1.041s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_qx_649pt' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:25:52 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c66689-e4e9-4476-8b4f-92b84219867e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:53 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD Jul 05 05:25:53 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:53 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD" returned: 0 in 0.918s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:53 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] a6f0222a-7d4a-45b3-a840-1e310c1a67bc was qcow2, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:25:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:53 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:25:53 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:56 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 0 in 2.103s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:56 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a6f0222a-7d4a-45b3-a840-1e310c1a67bc_9mns6di9devstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:25:56 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Converted 112.00 MB image at 53.20 MB/s Jul 05 05:25:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:56 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b 1G Jul 05 05:25:56 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:56 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b 1G" returned: 0 in 0.689s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aae2ca8-88ba-4c98-bc7c-05aa5ef4136c]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:25:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:56 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:25:56 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:57 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 0 in 0.979s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:25:57 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:25:57 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:25:58 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 1 in 0.922s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Downloaded image a6f0222a-7d4a-45b3-a840-1e310c1a67bc ((None, [{'url': 'file:///opt/stack/data/glance/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'metadata': {}}])) to volume 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Temporary image a6f0222a-7d4a-45b3-a840-1e310c1a67bc for user 8c5874bba1f2452dac7ba6a4543c192d is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Marking volume 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Copying metadata from image a6f0222a-7d4a-45b3-a840-1e310c1a67bc to 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Creating volume glance metadata for volume 9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b backed by image a6f0222a-7d4a-45b3-a840-1e310c1a67bc with: {'image_id': 'a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'image_name': 'tempest-scenario-img--887711013', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b892bd-3dfc-4343-9a30-8db4efb90ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b', 'volume_size': 1, 'image_id': 'a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--887711013', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd274cbe5b840467ba095cc4de2ce3d3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6f0222a-7d4a-45b3-a840-1e310c1a67bc', 'created_at': datetime.datetime(2026, 7, 5, 3, 25, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 25, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6f0222a-7d4a-45b3-a840-1e310c1a67bc/file', 'properties': {}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8f7cf9-5461-45df-88d5-d68c252c426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:25:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Volume volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b (9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b): created successfully Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8f7cf9-5461-45df-88d5-d68c252c426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:25:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Flow 'volume_create_manager' (93ad33d1-9331-4b88-a44d-02895fa91262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:25:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bea8f97b-8b3a-4f04-a066-91dfdd8e756c tempest-TestInstancesWithCinderVolumes-1265216336 None] Created volume successfully. Jul 05 05:26:08 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=61,cinder:INSERT=32,cinder:UPDATE=89,cinder:DELETE=8 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:26:08 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:INSERT=18,cinder:UPDATE=81,cinder:SELECT=67,cinder:DELETE=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:26:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:08 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8168f9bc-54cf-4529-86f8-58d9121bdaef]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:08 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:26:08 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:09 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 0 in 1.101s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:09 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:26:09 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:10 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 1 in 0.989s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:26:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.148s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '354cbf8d-23c4-4cc2-b893-463da0ee5ee9', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:26:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-085e3661-69ac-452d-9eac-3dcde37f0495 req-f8b9c0bc-48d4-4b42-a010-6da65c10869a tempest-TestInstancesWithCinderVolumes-1265216336 None] attachment_update completed successfully. Jul 05 05:26:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Acquiring lock "cinder-345c5d04-80dc-4a70-95ed-1f41d3dd792f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Lock "cinder-345c5d04-80dc-4a70-95ed-1f41d3dd792f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Acquiring lock "cinder-quobyte-345c5d04-80dc-4a70-95ed-1f41d3dd792f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Lock "cinder-quobyte-345c5d04-80dc-4a70-95ed-1f41d3dd792f" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc7a67-ee29-4374-9d7e-822d371d35ec]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:17 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f Jul 05 05:26:17 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:18 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f" returned: 0 in 0.872s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:18 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f Jul 05 05:26:18 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:19 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-345c5d04-80dc-4a70-95ed-1f41d3dd792f" returned: 0 in 0.933s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Lock "cinder-quobyte-345c5d04-80dc-4a70-95ed-1f41d3dd792f" released by "delete_volume" :: held 1.866s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Created reservations ['62c66828-34b3-487d-aa92-606b3e5852d0', '6640c533-3227-470d-86c3-7f63bcc599bd', 'be247f8d-5c1e-4609-9998-cce9dad22257', 'ded61226-4119-4410-b7bc-f5c33be74acb'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:19 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:19 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:21 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.603s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:21 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Deleted volume successfully. Jul 05 05:26:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-837c3b17-9e06-4fbc-856c-4a63afef0f2f tempest-VolumesNegativeTest-370358477 None] Lock "cinder-345c5d04-80dc-4a70-95ed-1f41d3dd792f-delete_volume" released by "delete_volume" :: held 3.872s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:23 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (e536d659-680f-498c-b153-def6e68e185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c43536b-d133-47eb-96cd-66635922ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c43536b-d133-47eb-96cd-66635922ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2032236814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4bea50-7e52-4e36-9540-aa3357ba7167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:24Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347d8beb-7eba-47fb-990f-9de32080543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347d8beb-7eba-47fb-990f-9de32080543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb005c35-6082-451e-a4a6-148cf0519314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb005c35-6082-451e-a4a6-148cf0519314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4bea50-7e52-4e36-9540-aa3357ba7167', 'volume_name': 'volume-7b4bea50-7e52-4e36-9540-aa3357ba7167', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c751c056-5498-4c5b-b923-101b5244b808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c751c056-5498-4c5b-b923-101b5244b808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a35698-9be5-4459-8410-da05b29e8c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:24 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume 7b4bea50-7e52-4e36-9540-aa3357ba7167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4bea50-7e52-4e36-9540-aa3357ba7167', 'volume_size': 1} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2032236814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4bea50-7e52-4e36-9540-aa3357ba7167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:24Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Creating volume 7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:26:24 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:26:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:24 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 1073741824 Jul 05 05:26:24 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:25 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 1073741824" returned: 0 in 1.102s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:25 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 Jul 05 05:26:25 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:25 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167" returned: 0 in 0.723s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:26:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a35698-9be5-4459-8410-da05b29e8c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4bea50-7e52-4e36-9540-aa3357ba7167', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303b2a7a-c8fe-4b3a-a2d1-da146803eafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:25 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 (7b4bea50-7e52-4e36-9540-aa3357ba7167): created successfully Jul 05 05:26:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303b2a7a-c8fe-4b3a-a2d1-da146803eafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (e536d659-680f-498c-b153-def6e68e185d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-288a8268-c3f1-499c-8122-e0e3cc9135c8 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created volume successfully. Jul 05 05:26:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Creating offline snapshot 11099c3f-fa08-477f-8a2b-1e8e4784ef52 of volume 7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:26:27 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da7207d-4aa5-4d64-8ddc-6f2143411d57]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:27 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 Jul 05 05:26:27 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:28 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167" returned: 0 in 0.899s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:28 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 1G Jul 05 05:26:28 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:29 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 1G" returned: 0 in 0.869s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:29 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 Jul 05 05:26:29 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:30 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:30 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 is being set with open permissions: ugo+rw Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:30 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 Jul 05 05:26:30 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:30 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:30 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:30 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52" returned: 0 in 0.815s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:30 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.info Jul 05 05:26:30 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:31 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.951s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:26:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:26:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:26:31 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.info" returned: 0 in 0.988s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:31 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.info is being set with open permissions: ugo+rw Jul 05 05:26:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:31 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.info Jul 05 05:26:31 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:32 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.info" returned: 0 in 0.809s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.367s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-135bbe8d-8efa-4c88-8985-482a02b0ed54 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Create snapshot completed successfully Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Flow 'volume_create_manager' (776261ae-29c9-4ec0-810c-92c707f30f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b454a13-2ae0-441e-84b6-de95e12ea890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b454a13-2ae0-441e-84b6-de95e12ea890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1661925580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48643753-fca8-433a-9520-14adf4d325d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaa9e74fe0b4373ba992dbccd0c6a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:33Z,use_quota=True,user_id='12fd6ae7e9094d3cb786a8460ffaeaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a56bad3-3820-43b6-b837-d150cc5875f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a56bad3-3820-43b6-b837-d150cc5875f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dbee3f-876c-4c22-83a7-1f21bfbcdbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dbee3f-876c-4c22-83a7-1f21bfbcdbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48643753-fca8-433a-9520-14adf4d325d9', 'volume_name': 'volume-48643753-fca8-433a-9520-14adf4d325d9', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a520895c-7c97-40cd-816d-8c8394a20819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a520895c-7c97-40cd-816d-8c8394a20819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa1bfa6-8283-4084-bac9-0ed0edfc8530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:33 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Volume 48643753-fca8-433a-9520-14adf4d325d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48643753-fca8-433a-9520-14adf4d325d9', 'volume_size': 1} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1661925580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48643753-fca8-433a-9520-14adf4d325d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbaa9e74fe0b4373ba992dbccd0c6a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:33Z,use_quota=True,user_id='12fd6ae7e9094d3cb786a8460ffaeaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Creating volume 48643753-fca8-433a-9520-14adf4d325d9 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:26:33 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:26:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:33 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 1073741824 Jul 05 05:26:33 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (e81c586c-4c45-40e2-be44-d54b3ab53610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f817de-20f2-4dc2-a7ab-937c3b6984d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f817de-20f2-4dc2-a7ab-937c3b6984d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553492037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:34Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec36cf1d-94ca-48b3-b5fd-c5922d050198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec36cf1d-94ca-48b3-b5fd-c5922d050198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d00df3-df49-4514-b5e3-6a30520ad7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d00df3-df49-4514-b5e3-6a30520ad7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1', 'volume_name': 'volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca0e28f-a7af-477b-9849-69f1beb54792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca0e28f-a7af-477b-9849-69f1beb54792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46ad960-f61e-4796-922f-3d67e714665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:34 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1', 'volume_size': 1} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:34 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 1073741824" returned: 0 in 1.110s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:34 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 Jul 05 05:26:34 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (b807a1cc-77ad-4e0b-81e1-a1e3f9139055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12d6b3a-ea10-4562-ac3f-ffe3e92290d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12d6b3a-ea10-4562-ac3f-ffe3e92290d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463253862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58da6e16-dc66-4423-a215-a6719f2518b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:35Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135ef335-82f5-4523-8139-170fd1e3a2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135ef335-82f5-4523-8139-170fd1e3a2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd76ca8-f1c9-46a7-a983-60557834cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd76ca8-f1c9-46a7-a983-60557834cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58da6e16-dc66-4423-a215-a6719f2518b0', 'volume_name': 'volume-58da6e16-dc66-4423-a215-a6719f2518b0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae508ae-70f6-468c-8dca-a33a11344438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae508ae-70f6-468c-8dca-a33a11344438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392026a0-a936-4747-b04a-4f055dd574c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume 58da6e16-dc66-4423-a215-a6719f2518b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58da6e16-dc66-4423-a215-a6719f2518b0', 'volume_size': 1} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (f00f134e-faed-4416-a55e-3709ad389fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca38c620-5fa3-45bd-97e6-cb9cea89850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca38c620-5fa3-45bd-97e6-cb9cea89850d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928868255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa070b42-6226-4465-8575-244bde1e6bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:35Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694c6840-38e0-4816-848e-d44d52265047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694c6840-38e0-4816-848e-d44d52265047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6659b649-0af7-4b65-b0d7-55ba97a97293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6659b649-0af7-4b65-b0d7-55ba97a97293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa070b42-6226-4465-8575-244bde1e6bf2', 'volume_name': 'volume-fa070b42-6226-4465-8575-244bde1e6bf2', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a8ba9-0127-4b35-9abd-0920b071d2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72a8ba9-0127-4b35-9abd-0920b071d2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3db8b1b-61a3-45e7-b138-5557b0ffe753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume fa070b42-6226-4465-8575-244bde1e6bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa070b42-6226-4465-8575-244bde1e6bf2', 'volume_size': 1} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:35 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9" returned: 0 in 0.839s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553492037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:34Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Creating volume ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:26:35 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:35 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 1073741824 Jul 05 05:26:35 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa1bfa6-8283-4084-bac9-0ed0edfc8530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48643753-fca8-433a-9520-14adf4d325d9', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44fb9a-4399-4d06-99be-b2cbfa288779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Volume volume-48643753-fca8-433a-9520-14adf4d325d9 (48643753-fca8-433a-9520-14adf4d325d9): created successfully Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44fb9a-4399-4d06-99be-b2cbfa288779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Flow 'volume_create_manager' (776261ae-29c9-4ec0-810c-92c707f30f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (afe47f8f-1f93-40da-acfe-dac1fc578b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d35230-c626-42ba-a14a-a9b785fbcbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c02a6791-20e0-41ba-abd8-78901533a129 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Created volume successfully. Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7d35230-c626-42ba-a14a-a9b785fbcbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800044964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f07e3c2-6e99-4343-9d56-71e5d238078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:36Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ed2b2e-6f17-44d5-8299-518ddf0a010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ed2b2e-6f17-44d5-8299-518ddf0a010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364766f3-8eaf-4381-8bc7-b3804dbdf283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364766f3-8eaf-4381-8bc7-b3804dbdf283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f07e3c2-6e99-4343-9d56-71e5d238078d', 'volume_name': 'volume-0f07e3c2-6e99-4343-9d56-71e5d238078d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd95c4-6e3d-40ef-8de1-afb3fd5c6e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd95c4-6e3d-40ef-8de1-afb3fd5c6e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae96ddc-7152-4e42-9d0d-a30fa3105bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume 0f07e3c2-6e99-4343-9d56-71e5d238078d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f07e3c2-6e99-4343-9d56-71e5d238078d', 'volume_size': 1} Jul 05 05:26:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (df37b1cf-291c-4e4a-868b-d365cdbbbcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b46a8e-ac95-405d-b9b7-c41204a3e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b46a8e-ac95-405d-b9b7-c41204a3e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465569410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe86b18-0fa2-4b77-83b3-fe483b06046b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:36Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb29f8a-1954-46b4-9987-4fbcb015e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb29f8a-1954-46b4-9987-4fbcb015e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdd530e-f47e-44e4-921d-aea32c2a5f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdd530e-f47e-44e4-921d-aea32c2a5f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe86b18-0fa2-4b77-83b3-fe483b06046b', 'volume_name': 'volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db91fe1c-d2b4-4c39-b08d-e97b48957c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db91fe1c-d2b4-4c39-b08d-e97b48957c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2787203-782d-4235-9dc2-9bab527a65d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume 7fe86b18-0fa2-4b77-83b3-fe483b06046b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b', 'volume_size': 1} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:36 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 1073741824" returned: 0 in 0.873s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:36 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 Jul 05 05:26:36 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:37 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1" returned: 0 in 0.693s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463253862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58da6e16-dc66-4423-a215-a6719f2518b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:35Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Creating volume 58da6e16-dc66-4423-a215-a6719f2518b0 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:26:37 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46ad960-f61e-4796-922f-3d67e714665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:37 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 1073741824 Jul 05 05:26:37 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006155be-bb70-40a8-9faf-8e6355f772d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 (ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1): created successfully Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006155be-bb70-40a8-9faf-8e6355f772d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (e81c586c-4c45-40e2-be44-d54b3ab53610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-14d42d32-a3ab-4dc4-a05a-0f45bf8b5134 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created volume successfully. Jul 05 05:26:38 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 1073741824" returned: 0 in 0.835s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:38 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 Jul 05 05:26:38 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:38 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0" returned: 0 in 0.663s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.388s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928868255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa070b42-6226-4465-8575-244bde1e6bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:35Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Creating volume fa070b42-6226-4465-8575-244bde1e6bf2 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:26:38 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:38 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 1073741824 Jul 05 05:26:38 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (392026a0-a936-4747-b04a-4f055dd574c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58da6e16-dc66-4423-a215-a6719f2518b0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df49d8a8-1fea-4b25-b8b9-1f07802813c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume volume-58da6e16-dc66-4423-a215-a6719f2518b0 (58da6e16-dc66-4423-a215-a6719f2518b0): created successfully Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df49d8a8-1fea-4b25-b8b9-1f07802813c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (b807a1cc-77ad-4e0b-81e1-a1e3f9139055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-65bf81d8-8f1f-4cb0-a876-5902c853039f tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created volume successfully. Jul 05 05:26:39 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 1073741824" returned: 0 in 0.857s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:39 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 Jul 05 05:26:39 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-170d365c-d443-4f77-80e3-ea18d5fdf653 req-f9e5b357-9b26-4606-9f7a-359ba8d9d453 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:40 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2" returned: 0 in 0.638s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.527s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1800044964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f07e3c2-6e99-4343-9d56-71e5d238078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:36Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Creating volume 0f07e3c2-6e99-4343-9d56-71e5d238078d {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:26:40 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3db8b1b-61a3-45e7-b138-5557b0ffe753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa070b42-6226-4465-8575-244bde1e6bf2', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:40 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d 1073741824 Jul 05 05:26:40 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b1e395-8b4d-4713-a0d0-c8d49271aabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:40 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume volume-fa070b42-6226-4465-8575-244bde1e6bf2 (fa070b42-6226-4465-8575-244bde1e6bf2): created successfully Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b1e395-8b4d-4713-a0d0-c8d49271aabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (f00f134e-faed-4416-a55e-3709ad389fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:40 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-38fa33f3-807d-441f-a355-ee165558118a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created volume successfully. Jul 05 05:26:41 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d 1073741824" returned: 0 in 0.820s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:41 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d Jul 05 05:26:41 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:41 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d" returned: 0 in 0.698s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.795s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465569410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe86b18-0fa2-4b77-83b3-fe483b06046b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45105e14e3a4eefb5537fa02d53fbcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:26:36Z,use_quota=True,user_id='bcdf529d17d3490c8c734c09c716a39b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Creating volume 7fe86b18-0fa2-4b77-83b3-fe483b06046b {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:26:41 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:41 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b 1073741824 Jul 05 05:26:41 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae96ddc-7152-4e42-9d0d-a30fa3105bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f07e3c2-6e99-4343-9d56-71e5d238078d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e084eec-99ae-4384-a907-7ed1b70a49a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume volume-0f07e3c2-6e99-4343-9d56-71e5d238078d (0f07e3c2-6e99-4343-9d56-71e5d238078d): created successfully Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e084eec-99ae-4384-a907-7ed1b70a49a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (afe47f8f-1f93-40da-acfe-dac1fc578b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-047bd4e9-58ec-436e-92cc-95c917a3b9dd tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created volume successfully. Jul 05 05:26:42 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b 1073741824" returned: 0 in 0.913s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:42 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b Jul 05 05:26:42 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:43 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b" returned: 0 in 0.681s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-170d365c-d443-4f77-80e3-ea18d5fdf653 req-f9e5b357-9b26-4606-9f7a-359ba8d9d453 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.724s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2787203-782d-4235-9dc2-9bab527a65d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e396d36-e609-41a8-bd55-1df73f3ab44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[34428e0f-961d-4383-870e-0e5d9bed7b37]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-170d365c-d443-4f77-80e3-ea18d5fdf653 req-f9e5b357-9b26-4606-9f7a-359ba8d9d453 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:43 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Volume volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b (7fe86b18-0fa2-4b77-83b3-fe483b06046b): created successfully Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e396d36-e609-41a8-bd55-1df73f3ab44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:26:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Flow 'volume_create_manager' (df37b1cf-291c-4e4a-868b-d365cdbbbcfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:26:43 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3e28e2cc-a97c-475c-815a-14d3460a0af5 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created volume successfully. Jul 05 05:26:43 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 Jul 05 05:26:43 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:44 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-170d365c-d443-4f77-80e3-ea18d5fdf653 req-f9e5b357-9b26-4606-9f7a-359ba8d9d453 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9" returned: 0 in 0.814s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-170d365c-d443-4f77-80e3-ea18d5fdf653 req-f9e5b357-9b26-4606-9f7a-359ba8d9d453 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-170d365c-d443-4f77-80e3-ea18d5fdf653 req-f9e5b357-9b26-4606-9f7a-359ba8d9d453 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-48643753-fca8-433a-9520-14adf4d325d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cde9eeed-b89e-4ff1-9142-f61862771e7e', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:26:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-170d365c-d443-4f77-80e3-ea18d5fdf653 req-f9e5b357-9b26-4606-9f7a-359ba8d9d453 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] attachment_update completed successfully. Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-7fe86b18-0fa2-4b77-83b3-fe483b06046b-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-7fe86b18-0fa2-4b77-83b3-fe483b06046b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-7fe86b18-0fa2-4b77-83b3-fe483b06046b" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-7fe86b18-0fa2-4b77-83b3-fe483b06046b" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd07b76-221e-4fef-b8c1-b65fa98cf121]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:44 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b Jul 05 05:26:44 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:45 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b" returned: 0 in 0.781s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:45 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b Jul 05 05:26:45 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:46 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7fe86b18-0fa2-4b77-83b3-fe483b06046b" returned: 0 in 0.652s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-7fe86b18-0fa2-4b77-83b3-fe483b06046b" released by "delete_volume" :: held 1.481s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created reservations ['f63505d0-8b51-4692-a833-2b057212fb17', '85c9b096-ace1-41ba-88f3-09a4c41b3cf9', 'ae5706b5-faf8-4f71-9a3a-c6c544fd159e', 'c1595b1e-c8df-4cc2-92c1-688130e8399e'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:46 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:46 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-0f07e3c2-6e99-4343-9d56-71e5d238078d-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-0f07e3c2-6e99-4343-9d56-71e5d238078d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-0f07e3c2-6e99-4343-9d56-71e5d238078d" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:47 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-0f07e3c2-6e99-4343-9d56-71e5d238078d" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.751s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Deleted volume successfully. Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f57752-e9f9-4f4b-bdb9-8df7edf3e7e3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-006f708d-c751-410d-b923-c774d07b718b tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-7fe86b18-0fa2-4b77-83b3-fe483b06046b-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:47 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d Jul 05 05:26:47 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:47 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d" returned: 0 in 0.799s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:47 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d Jul 05 05:26:47 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:48 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0f07e3c2-6e99-4343-9d56-71e5d238078d" returned: 0 in 0.662s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-0f07e3c2-6e99-4343-9d56-71e5d238078d" released by "delete_volume" :: held 1.506s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created reservations ['f7459d8e-f8fa-440d-bd4b-0716187bac83', 'e46c643e-8ddb-4c20-b0e1-f0e5f3123d87', 'f156ac1a-d4ff-4234-8d2c-4ac01629af72', 'b27d84ec-8f6d-4745-94eb-8df27039a2a3'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:48 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:48 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-fa070b42-6226-4465-8575-244bde1e6bf2-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-fa070b42-6226-4465-8575-244bde1e6bf2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-fa070b42-6226-4465-8575-244bde1e6bf2" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-fa070b42-6226-4465-8575-244bde1e6bf2" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd72cbaa-33e5-40ff-a675-6f2d7db1559a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:49 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.717s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Deleted volume successfully. Jul 05 05:26:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d9e64c9d-a8c4-4419-8ce0-1f6fd6b95a39 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-0f07e3c2-6e99-4343-9d56-71e5d238078d-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:49 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 Jul 05 05:26:49 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:50 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2" returned: 0 in 0.902s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:50 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2 Jul 05 05:26:50 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-778152bf-1a3c-4821-bb64-860d0504bdfd req-650362ee-f586-4a3c-89f5-225b807b6342 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-778152bf-1a3c-4821-bb64-860d0504bdfd req-650362ee-f586-4a3c-89f5-225b807b6342 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101a3ff-c436-40c6-a075-f3f49b242ac4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-778152bf-1a3c-4821-bb64-860d0504bdfd req-650362ee-f586-4a3c-89f5-225b807b6342 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:50 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 Jul 05 05:26:50 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:50 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fa070b42-6226-4465-8575-244bde1e6bf2" returned: 0 in 0.691s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-fa070b42-6226-4465-8575-244bde1e6bf2" released by "delete_volume" :: held 1.657s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created reservations ['9a5602a5-8ef3-40c3-b167-2e11b73b538d', '3cbd373d-b587-4fb8-b8e1-d02e752c29b7', 'be71514a-4bb9-4193-8595-045e123671e5', '1cd801ce-9fe4-4285-a490-bdfe18f93033'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:51 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:51 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:51 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-778152bf-1a3c-4821-bb64-860d0504bdfd req-650362ee-f586-4a3c-89f5-225b807b6342 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81" returned: 0 in 0.828s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-778152bf-1a3c-4821-bb64-860d0504bdfd req-650362ee-f586-4a3c-89f5-225b807b6342 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-778152bf-1a3c-4821-bb64-860d0504bdfd req-650362ee-f586-4a3c-89f5-225b807b6342 tempest-TestInstancesWithCinderVolumes-1265216336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed4ecff0-7d72-4920-9a80-930b1c56f11e', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:26:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-778152bf-1a3c-4821-bb64-860d0504bdfd req-650362ee-f586-4a3c-89f5-225b807b6342 tempest-TestInstancesWithCinderVolumes-1265216336 None] attachment_update completed successfully. Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-58da6e16-dc66-4423-a215-a6719f2518b0-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-58da6e16-dc66-4423-a215-a6719f2518b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-58da6e16-dc66-4423-a215-a6719f2518b0" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-58da6e16-dc66-4423-a215-a6719f2518b0" acquired by "delete_volume" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f50881-3fcb-4939-885f-18f561f2bde1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-5d297baf-9ae0-448d-81a5-5fe5b571a306 req-d147e399-4a1d-4e76-9fed-a5ad5ff16c30 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Terminate volume connection completed successfully. Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-5d297baf-9ae0-448d-81a5-5fe5b571a306 req-d147e399-4a1d-4e76-9fed-a5ad5ff16c30 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Deleting attachment cde9eeed-b89e-4ff1-9142-f61862771e7e. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:26:51 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 Jul 05 05:26:51 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:51 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.762s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Deleted volume successfully. Jul 05 05:26:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6e177029-7808-44f4-b0cf-d07f14c2edce tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-fa070b42-6226-4465-8575-244bde1e6bf2-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:52 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0" returned: 0 in 0.806s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:52 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0 Jul 05 05:26:52 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:53 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-58da6e16-dc66-4423-a215-a6719f2518b0" returned: 0 in 0.660s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-58da6e16-dc66-4423-a215-a6719f2518b0" released by "delete_volume" :: held 1.523s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created reservations ['993c5e87-b7f5-44d4-91bb-edd696c5a52c', 'db7c8247-ec12-4c89-b073-a2b2cf7b72c4', '26b4415e-0ab1-4f40-b280-026b148dd05b', '80feb809-bb9f-460f-97ab-c100c7d8c00d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:53 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:53 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Acquiring lock "cinder-48643753-fca8-433a-9520-14adf4d325d9-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "cinder-48643753-fca8-433a-9520-14adf4d325d9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Acquiring lock "cinder-quobyte-48643753-fca8-433a-9520-14adf4d325d9" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "cinder-quobyte-48643753-fca8-433a-9520-14adf4d325d9" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5ae960-e575-4363-ad92-d162b4c24250]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:53 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 Jul 05 05:26:53 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:53 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.695s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Deleted volume successfully. Jul 05 05:26:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-609471c4-7c83-487c-ac57-177918b6544a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-58da6e16-dc66-4423-a215-a6719f2518b0-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c827801-48db-45c9-9ae3-32820058d88c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:54 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 Jul 05 05:26:54 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:54 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9" returned: 0 in 0.793s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:54 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9 Jul 05 05:26:54 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:54 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1" returned: 0 in 0.795s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:54 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1 Jul 05 05:26:54 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:55 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-48643753-fca8-433a-9520-14adf4d325d9" returned: 0 in 0.702s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "cinder-quobyte-48643753-fca8-433a-9520-14adf4d325d9" released by "delete_volume" :: held 1.553s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Created reservations ['8cc135bf-7325-4b3d-b02f-957b572af8e1', 'eef07ac4-da73-49ff-8ebc-319688a619e7', 'f79ded35-48b4-4284-9cc8-018973363a3f', '18dde8e1-3756-4a43-9d4a-c28b57d5bbaf'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:55 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:55 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:55 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1" returned: 0 in 0.711s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1" released by "delete_volume" :: held 1.557s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created reservations ['dd28dee6-99d8-4d0b-8a24-79f31411e8ff', '03d84590-7a16-4071-b91a-d5f28a54ba83', 'ab42f4a7-3146-4b92-bfa7-10ad0452398c', '276232d6-479f-405d-812f-e6c0d8fd50c9'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:55 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:26:55 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:56 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.702s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Deleted volume successfully. Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-eb8faaae-e6dc-4057-ad9a-451405138851 tempest-TestServerVolumeAttachScenarioOldVersion-2142666468 None] Lock "cinder-48643753-fca8-433a-9520-14adf4d325d9-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-11099c3f-fa08-477f-8a2b-1e8e4784ef52-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-11099c3f-fa08-477f-8a2b-1e8e4784ef52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-7b4bea50-7e52-4e36-9540-aa3357ba7167" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-7b4bea50-7e52-4e36-9540-aa3357ba7167" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-11099c3f-fa08-477f-8a2b-1e8e4784ef52" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-11099c3f-fa08-477f-8a2b-1e8e4784ef52" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Deleting offline snapshot 11099c3f-fa08-477f-8a2b-1e8e4784ef52 of volume 7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] snapshot_file for this snap is: volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5cd6a3-aee0-4d17-a488-ebb91a3c4669]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:56 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 Jul 05 05:26:56 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:56 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.720s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:26:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Deleted volume successfully. Jul 05 05:26:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-735edd62-fb72-493c-a565-94aa74653ed0 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-ec4c70a2-6c0a-48b0-8d1f-785f475c7cc1-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:57 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52" returned: 0 in 0.809s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b4bea50-7e52-4e36-9540-aa3357ba7167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:26:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5df6f0-c774-4727-8097-bfdf97896188]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:57 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 Jul 05 05:26:57 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:58 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167" returned: 0 in 0.909s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:58 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 Jul 05 05:26:58 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-b0aad059-27f5-429c-b7ac-ee48213b24d0 req-a3835222-da9b-4233-84b9-3ac8fabdfea4 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:26:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-b0aad059-27f5-429c-b7ac-ee48213b24d0 req-a3835222-da9b-4233-84b9-3ac8fabdfea4 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:26:58 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67676eb-288d-4c96-b42f-747955d4da61]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:26:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-b0aad059-27f5-429c-b7ac-ee48213b24d0 req-a3835222-da9b-4233-84b9-3ac8fabdfea4 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:59 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52" returned: 0 in 0.888s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:26:59 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52 Jul 05 05:26:59 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:59 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 Jul 05 05:26:59 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:26:59 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167.11099c3f-fa08-477f-8a2b-1e8e4784ef52" returned: 0 in 0.822s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:59 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-b0aad059-27f5-429c-b7ac-ee48213b24d0 req-a3835222-da9b-4233-84b9-3ac8fabdfea4 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5" returned: 0 in 0.896s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-b0aad059-27f5-429c-b7ac-ee48213b24d0 req-a3835222-da9b-4233-84b9-3ac8fabdfea4 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-11099c3f-fa08-477f-8a2b-1e8e4784ef52" released by "_delete_snapshot" :: held 3.537s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-7b4bea50-7e52-4e36-9540-aa3357ba7167" released by "delete_snapshot" :: held 3.561s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-b0aad059-27f5-429c-b7ac-ee48213b24d0 req-a3835222-da9b-4233-84b9-3ac8fabdfea4 tempest-TestInstancesWithCinderVolumes-1265216336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-1e46e062-ceab-47ff-aa68-137ed0206fe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9db3420d-8694-483c-b0cb-da7fe0d72ccc', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:26:59 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created reservations ['e38b2b16-2935-44d8-9244-e46ed4b2113e', '7500b3df-abf5-4439-82c3-c39df0dfbc4a', '27d07d92-1d2e-4e1b-b8a4-046ec60bcc92', 'e7709109-5785-4307-a9f5-e59089dfadd2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:26:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-b0aad059-27f5-429c-b7ac-ee48213b24d0 req-a3835222-da9b-4233-84b9-3ac8fabdfea4 tempest-TestInstancesWithCinderVolumes-1265216336 None] attachment_update completed successfully. Jul 05 05:27:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Delete snapshot completed successfully. Jul 05 05:27:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-db3a6818-4810-48c0-ac54-dcd76bc31615 tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-11099c3f-fa08-477f-8a2b-1e8e4784ef52-delete_snapshot" released by "delete_snapshot" :: held 3.759s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-7b4bea50-7e52-4e36-9540-aa3357ba7167-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-7b4bea50-7e52-4e36-9540-aa3357ba7167-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "cinder-quobyte-7b4bea50-7e52-4e36-9540-aa3357ba7167" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-7b4bea50-7e52-4e36-9540-aa3357ba7167" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[26583984-0ea3-47ff-9186-30a491398891]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:00 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 Jul 05 05:27:00 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:01 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:01 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167 Jul 05 05:27:01 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:02 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7b4bea50-7e52-4e36-9540-aa3357ba7167" returned: 0 in 0.661s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-quobyte-7b4bea50-7e52-4e36-9540-aa3357ba7167" released by "delete_volume" :: held 1.510s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Created reservations ['5a855242-1348-44ad-8750-411e7c1de7c3', '5c0c0bf8-1bac-484c-8478-83846c486e50', '628a8c79-b59c-44eb-8844-a4701e015731', 'e95a25c9-6c7c-4d36-8ff5-de9408aad1c8'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:02 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:02 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:02 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.671s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:02 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Deleted volume successfully. Jul 05 05:27:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7fc7ab91-5b90-4af5-94d0-8351b763ec8a tempest-CreateVolumesFromSnapshotTest-1589808415 None] Lock "cinder-7b4bea50-7e52-4e36-9540-aa3357ba7167-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=86,cinder:UPDATE=92,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=106,cinder:SELECT=86,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Flow 'volume_create_manager' (daf1a357-1e47-4899-927c-72b8a1bda77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d60207-f6d0-4770-93db-5fe9e2c699a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d60207-f6d0-4770-93db-5fe9e2c699a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c75059-b0cb-4673-8b9c-2f5b99ee61b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27628798dd04012b7cb78384c3b5691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:09Z,use_quota=True,user_id='278196f5bed7478d9921af1269fdb371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cfc4a5-482e-4f8c-90cb-bed3aef8a89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cfc4a5-482e-4f8c-90cb-bed3aef8a89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde15457-f3b0-4e16-af78-38d9f978170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde15457-f3b0-4e16-af78-38d9f978170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94c75059-b0cb-4673-8b9c-2f5b99ee61b2', 'volume_name': 'volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2', 'volume_size': 1, 'image_id': 'b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a794ce74a4208aff406a12c6e736ec8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c27628798dd04012b7cb78384c3b5691', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91a80abb076c165c5cdaa70b0d955fc30ad3058c15c957dbcb69888e7e5cf96e6f4931c767ea2a7e0f3b3f44eb1f442a79a6803e8ae68f7c2d4392001c661114', 'id': 'b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'created_at': datetime.datetime(2026, 7, 5, 3, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87/file', 'properties': {}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14942b68-b977-4274-bdd7-4ee213ceaf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14942b68-b977-4274-bdd7-4ee213ceaf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983ddba5-73a6-47ef-93a5-235a2c74a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Volume 94c75059-b0cb-4673-8b9c-2f5b99ee61b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2', 'volume_size': 1, 'image_id': 'b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a794ce74a4208aff406a12c6e736ec8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c27628798dd04012b7cb78384c3b5691', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91a80abb076c165c5cdaa70b0d955fc30ad3058c15c957dbcb69888e7e5cf96e6f4931c767ea2a7e0f3b3f44eb1f442a79a6803e8ae68f7c2d4392001c661114', 'id': 'b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'created_at': datetime.datetime(2026, 7, 5, 3, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87/file', 'properties': {}}, 'image_service': } Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Trying to clone 94c75059-b0cb-4673-8b9c-2f5b99ee61b2 from image b5480b76-af5f-4d2a-a45f-a277ba4b2e87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:27:09 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Image download 0.00 MB at 0.00 MB/s Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b57a258-692e-40a8-a123-205fafdb186d]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:09 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD Jul 05 05:27:09 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-858878e3-222b-4f22-b2c4-c38e41ae7bd1 req-ef755be4-3803-416f-8270-1cb6f303b3d7 tempest-TestInstancesWithCinderVolumes-1265216336 None] Terminate volume connection completed successfully. Jul 05 05:27:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-858878e3-222b-4f22-b2c4-c38e41ae7bd1 req-ef755be4-3803-416f-8270-1cb6f303b3d7 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deleting attachment ed4ecff0-7d72-4920-9a80-930b1c56f11e. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:27:10 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:10 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD Jul 05 05:27:10 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:11 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:27:11 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Temporary image b5480b76-af5f-4d2a-a45f-a277ba4b2e87 is fetched for user 278196f5bed7478d9921af1269fdb371. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:27:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1afeacf-1328-4e54-add1-491cf0c6e5fb]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:11 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD Jul 05 05:27:11 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:12 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:12 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD Jul 05 05:27:12 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "cinder-cd24bb96-eafb-4db8-a811-25d85c0e2f81-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-cd24bb96-eafb-4db8-a811-25d85c0e2f81-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "cinder-quobyte-cd24bb96-eafb-4db8-a811-25d85c0e2f81" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-quobyte-cd24bb96-eafb-4db8-a811-25d85c0e2f81" acquired by "delete_volume" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb86e61-b87c-4eb9-bc6c-2b4bde68988b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:12 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 Jul 05 05:27:12 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:13 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD" returned: 1 in 0.919s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94c75059-b0cb-4673-8b9c-2f5b99ee61b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27628798dd04012b7cb78384c3b5691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:09Z,use_quota=True,user_id='278196f5bed7478d9921af1269fdb371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Creating volume 94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:27:13 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:13 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 1073741824 Jul 05 05:27:13 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:13 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81" returned: 0 in 0.982s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:13 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81 Jul 05 05:27:13 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:14 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 1073741824" returned: 0 in 1.166s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:14 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 Jul 05 05:27:14 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:14 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd24bb96-eafb-4db8-a811-25d85c0e2f81" returned: 0 in 0.967s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-quobyte-cd24bb96-eafb-4db8-a811-25d85c0e2f81" released by "delete_volume" :: held 2.019s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:14 devstack cinder-volume[86688]: WARNING cinder.quota [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872159001-1551705378 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872159001-1551705378, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:27:14 devstack cinder-volume[86688]: WARNING cinder.quota [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872159001-1551705378 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-872159001-1551705378, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Created reservations ['dadc9ad8-6188-4bcc-bc02-8b60f9feb46a', 'f26c4241-3e06-4aa7-8458-a2aa467d2e39', '8a21f170-3121-43ab-9497-770dd2186d7b', 'ca98b508-54a3-48e3-a139-74d232dabbeb'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:14 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:14 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:15 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" returned: 0 in 0.791s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Attempting download of b5480b76-af5f-4d2a-a45f-a277ba4b2e87 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'metadata': {}}])) to volume 94c75059-b0cb-4673-8b9c-2f5b99ee61b2. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd2b0b5-32d6-4611-9af3-f8bdcead8780]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_m3537mvp {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:15 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_m3537mvp Jul 05 05:27:15 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:15 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.793s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deleted volume successfully. Jul 05 05:27:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d4417fa8-0ce9-41ff-9330-237fd082f8d3 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-cd24bb96-eafb-4db8-a811-25d85c0e2f81-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:16 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_m3537mvp" returned: 0 in 0.806s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_m3537mvp {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:16 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_m3537mvp Jul 05 05:27:16 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Flow 'volume_create_manager' (7bdedfa0-1ead-4f1e-bc34-b8ef32ef7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a1eb42-8d8c-4362-bf06-eacaad151b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a1eb42-8d8c-4362-bf06-eacaad151b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1329970842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217b392a-4c66-4340-8ca5-dca2d4d3425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdae094be042e1a24e51993ca43259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:16Z,use_quota=True,user_id='28e98cc3e829493f8f0e2887c9cd95da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1b7235-2d62-410c-a537-cbf3c9696695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1b7235-2d62-410c-a537-cbf3c9696695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d868d9-8782-451e-a646-1e91b9644c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d868d9-8782-451e-a646-1e91b9644c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217b392a-4c66-4340-8ca5-dca2d4d3425e', 'volume_name': 'volume-217b392a-4c66-4340-8ca5-dca2d4d3425e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6788bd52-ee20-44f5-b10f-7177b04d203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6788bd52-ee20-44f5-b10f-7177b04d203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23968d46-9791-4423-bf80-dd21742abbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:16 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Volume 217b392a-4c66-4340-8ca5-dca2d4d3425e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217b392a-4c66-4340-8ca5-dca2d4d3425e', 'volume_size': 1} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1329970842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217b392a-4c66-4340-8ca5-dca2d4d3425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdae094be042e1a24e51993ca43259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:16Z,use_quota=True,user_id='28e98cc3e829493f8f0e2887c9cd95da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Creating volume 217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:27:16 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:16 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e 1073741824 Jul 05 05:27:16 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:16 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_m3537mvp" returned: 1 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_m3537mvp' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08346e6-10e9-4533-b1ca-2b943666b259]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:16 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD Jul 05 05:27:16 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:17 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e 1073741824" returned: 0 in 0.875s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:17 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e Jul 05 05:27:17 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-c18c3c56-2759-4779-8afd-2af90bc339b3 req-c78bbe76-5b97-4e1a-9326-629159a6bb76 tempest-TestInstancesWithCinderVolumes-1265216336 None] Terminate volume connection completed successfully. Jul 05 05:27:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-c18c3c56-2759-4779-8afd-2af90bc339b3 req-c78bbe76-5b97-4e1a-9326-629159a6bb76 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deleting attachment 9db3420d-8694-483c-b0cb-da7fe0d72ccc. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:27:17 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:17 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD Jul 05 05:27:17 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:18 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e" returned: 0 in 0.687s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23968d46-9791-4423-bf80-dd21742abbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217b392a-4c66-4340-8ca5-dca2d4d3425e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e40576-f6ed-4cc9-948d-38bddf6d7691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:18 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Volume volume-217b392a-4c66-4340-8ca5-dca2d4d3425e (217b392a-4c66-4340-8ca5-dca2d4d3425e): created successfully Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e40576-f6ed-4cc9-948d-38bddf6d7691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Flow 'volume_create_manager' (7bdedfa0-1ead-4f1e-bc34-b8ef32ef7229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8efa5ec8-2673-41ab-9afe-a46d3c1fa612 tempest-VolumeDependencyTests-809229378 None] Created volume successfully. Jul 05 05:27:18 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD" returned: 1 in 0.769s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] b5480b76-af5f-4d2a-a45f-a277ba4b2e87 was raw, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:18 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 Jul 05 05:27:18 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Creating offline snapshot d63a2b4e-9b3f-4008-b2dd-b535b624aa66 of volume 217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b908d-c0bc-462b-a13d-706daea7fb10]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:18 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e Jul 05 05:27:18 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:19 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" returned: 0 in 0.751s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5480b76-af5f-4d2a-a45f-a277ba4b2e87_s9pp6qqedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:27:19 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:19 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 1G Jul 05 05:27:19 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:19 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e" returned: 0 in 0.791s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:19 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 1G Jul 05 05:27:19 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "cinder-1e46e062-ceab-47ff-aa68-137ed0206fe5-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-1e46e062-ceab-47ff-aa68-137ed0206fe5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "cinder-quobyte-1e46e062-ceab-47ff-aa68-137ed0206fe5" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-quobyte-1e46e062-ceab-47ff-aa68-137ed0206fe5" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e8539f-a166-4770-ad5d-7ccaa5293dbd]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:19 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 Jul 05 05:27:19 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:19 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 1G" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb01cc8-2a81-44e2-be90-bba3637030ef]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:20 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 Jul 05 05:27:20 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:20 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 1G" returned: 0 in 0.918s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-217b392a-4c66-4340-8ca5-dca2d4d3425e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:20 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-217b392a-4c66-4340-8ca5-dca2d4d3425e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 Jul 05 05:27:20 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:20 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5" returned: 0 in 0.920s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:20 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5 Jul 05 05:27:20 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:20 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" returned: 0 in 0.927s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:21 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 Jul 05 05:27:21 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:21 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-217b392a-4c66-4340-8ca5-dca2d4d3425e -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66" returned: 0 in 1.039s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:21 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 is being set with open permissions: ugo+rw Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:21 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 Jul 05 05:27:21 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:21 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1e46e062-ceab-47ff-aa68-137ed0206fe5" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-quobyte-1e46e062-ceab-47ff-aa68-137ed0206fe5" released by "delete_volume" :: held 1.889s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:21 devstack cinder-volume[86688]: WARNING cinder.quota [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745550152-1099057327 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745550152-1099057327, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:27:21 devstack cinder-volume[86688]: WARNING cinder.quota [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745550152-1099057327 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-745550152-1099057327, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Created reservations ['b9d6f6e6-cb8d-48d0-b815-620061bd76b8', '84270082-7f44-4b79-a1a4-34a09230b2be', 'b828e75e-d457-444e-8e4e-bb0aad71153a', '8dcfab1d-b98a-4375-82da-bc23cb8dd1b2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:21 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:21 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:21 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" returned: 1 in 1.067s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Downloaded image b5480b76-af5f-4d2a-a45f-a277ba4b2e87 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'metadata': {}}])) to volume 94c75059-b0cb-4673-8b9c-2f5b99ee61b2 successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Temporary image b5480b76-af5f-4d2a-a45f-a277ba4b2e87 for user 278196f5bed7478d9921af1269fdb371 is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Marking volume 94c75059-b0cb-4673-8b9c-2f5b99ee61b2 as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Copying metadata from image b5480b76-af5f-4d2a-a45f-a277ba4b2e87 to 94c75059-b0cb-4673-8b9c-2f5b99ee61b2. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Creating volume glance metadata for volume 94c75059-b0cb-4673-8b9c-2f5b99ee61b2 backed by image b5480b76-af5f-4d2a-a45f-a277ba4b2e87 with: {'image_id': 'b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2a794ce74a4208aff406a12c6e736ec8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983ddba5-73a6-47ef-93a5-235a2c74a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2', 'volume_size': 1, 'image_id': 'b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2a794ce74a4208aff406a12c6e736ec8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c27628798dd04012b7cb78384c3b5691', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91a80abb076c165c5cdaa70b0d955fc30ad3058c15c957dbcb69888e7e5cf96e6f4931c767ea2a7e0f3b3f44eb1f442a79a6803e8ae68f7c2d4392001c661114', 'id': 'b5480b76-af5f-4d2a-a45f-a277ba4b2e87', 'created_at': datetime.datetime(2026, 7, 5, 3, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5480b76-af5f-4d2a-a45f-a277ba4b2e87/file', 'properties': {}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b79843a-af11-44ce-ad72-504df575f31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:22 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Volume volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 (94c75059-b0cb-4673-8b9c-2f5b99ee61b2): created successfully Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b79843a-af11-44ce-ad72-504df575f31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Flow 'volume_create_manager' (daf1a357-1e47-4899-927c-72b8a1bda77c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bd14c9fd-4e2d-4cb7-88af-aafdf4c59f3a tempest-VolumeImageDependencyTests-219164280 None] Created volume successfully. Jul 05 05:27:22 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66" returned: 0 in 0.958s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:22 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.info Jul 05 05:27:22 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:22 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.951s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deleted volume successfully. Jul 05 05:27:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-06f1475d-83a8-4caa-b7a0-0fd2f0cc1751 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-1e46e062-ceab-47ff-aa68-137ed0206fe5-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:23 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.info" returned: 0 in 0.719s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:23 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.info is being set with open permissions: ugo+rw Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Acquiring lock "cinder-94c75059-b0cb-4673-8b9c-2f5b99ee61b2-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:23 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.info Jul 05 05:27:23 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Lock "cinder-94c75059-b0cb-4673-8b9c-2f5b99ee61b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Acquiring lock "cinder-quobyte-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Lock "cinder-quobyte-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0acb1d2-fe0e-4dc9-ae75-0859540050d4]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:23 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 Jul 05 05:27:23 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:23 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.info" returned: 0 in 0.689s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.253s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b397a41d-f238-487e-bb6f-234598bdf87a tempest-VolumeDependencyTests-809229378 None] Create snapshot completed successfully Jul 05 05:27:24 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:24 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 Jul 05 05:27:24 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:25 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" returned: 1 in 0.893s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:25 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2 Jul 05 05:27:25 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Flow 'volume_create_manager' (c2b777ec-dd56-4628-8ef4-c407347ec99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40fae89-2c75-4cd8-8eb9-a4cf7cee8ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40fae89-2c75-4cd8-8eb9-a4cf7cee8ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-863090353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7736bf7a-1cb4-4268-b433-5368366c068c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fdae094be042e1a24e51993ca43259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d63a2b4e-9b3f-4008-b2dd-b535b624aa66,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:26Z,use_quota=True,user_id='28e98cc3e829493f8f0e2887c9cd95da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f075211-91f2-4c53-84ad-f21e225a7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f075211-91f2-4c53-84ad-f21e225a7654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161017d7-07f9-4f0e-bea9-74d40041226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161017d7-07f9-4f0e-bea9-74d40041226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7736bf7a-1cb4-4268-b433-5368366c068c', 'volume_name': 'volume-7736bf7a-1cb4-4268-b433-5368366c068c', 'volume_size': 1, 'snapshot_id': 'd63a2b4e-9b3f-4008-b2dd-b535b624aa66'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de372fee-ba77-4619-9e8d-aad612cb8d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de372fee-ba77-4619-9e8d-aad612cb8d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c913c10b-b442-489a-aa2d-35cf5da17412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:25 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Volume 7736bf7a-1cb4-4268-b433-5368366c068c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7736bf7a-1cb4-4268-b433-5368366c068c', 'volume_size': 1, 'snapshot_id': 'd63a2b4e-9b3f-4008-b2dd-b535b624aa66'} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-quobyte-d63a2b4e-9b3f-4008-b2dd-b535b624aa66-7736bf7a-1cb4-4268-b433-5368366c068c" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-d63a2b4e-9b3f-4008-b2dd-b535b624aa66-7736bf7a-1cb4-4268-b433-5368366c068c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Creating volume 7736bf7a-1cb4-4268-b433-5368366c068c from snapshot d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-quobyte-7736bf7a-1cb4-4268-b433-5368366c068c" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-7736bf7a-1cb4-4268-b433-5368366c068c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] snapshot: d63a2b4e-9b3f-4008-b2dd-b535b624aa66, volume: 7736bf7a-1cb4-4268-b433-5368366c068c, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:27:26 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" returned: 0 in 0.900s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb18415-2b2a-4753-a613-9d0b8a35cc88]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Lock "cinder-quobyte-94c75059-b0cb-4673-8b9c-2f5b99ee61b2" released by "delete_volume" :: held 2.729s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Created reservations ['39d437a2-99fa-4007-b8f3-1da284048779', '522843e5-1f76-4167-a367-e4fa683471e5', '04fcb1f6-9f34-4d2b-b31f-ae078bae0584', '1e49ad91-4e5a-41f8-b1c8-efbc8de7a213'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:26 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 Jul 05 05:27:26 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:26 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:26 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:26 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66" returned: 0 in 0.853s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-217b392a-4c66-4340-8ca5-dca2d4d3425e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01301e5-415e-4853-bffd-77a26b85ca06]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:26 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.750s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Deleted volume successfully. Jul 05 05:27:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-75e726a7-81be-45ff-86a3-ed3403cd13ca req-cdd50b4f-2685-4b49-bc95-d488a8298108 tempest-TestInstancesWithCinderVolumes-1265216336 None] Terminate volume connection completed successfully. Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-75e726a7-81be-45ff-86a3-ed3403cd13ca req-cdd50b4f-2685-4b49-bc95-d488a8298108 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deleting attachment 354cbf8d-23c4-4cc2-b893-463da0ee5ee9. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:27:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5aee0840-030e-4e10-8b59-a7c9b3e15901 tempest-VolumeImageDependencyTests-219164280 None] Lock "cinder-94c75059-b0cb-4673-8b9c-2f5b99ee61b2-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:27 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e Jul 05 05:27:27 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:27 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e" returned: 0 in 0.870s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:27 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:27:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:27 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c Jul 05 05:27:27 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:30 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "cinder-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:30 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "cinder-quobyte-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-quobyte-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" acquired by "delete_volume" :: waited 0.044s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[043a6a57-a27d-4e11-b354-fa0a45139afe]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:27:31 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:27:31 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Flow 'volume_create_manager' (1be946c8-ab2b-41e9-8c56-c463dbe4e866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b20bef-a914-4287-abb3-95dec5682813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b20bef-a914-4287-abb3-95dec5682813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce9ea6a81ea4fb38e3663ad3df0880d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:31Z,use_quota=True,user_id='2bf6c7601f794dcc8aeb5b67713305d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bad422f-ee24-44e1-9fc9-463fea8726bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bad422f-ee24-44e1-9fc9-463fea8726bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a2d226-ef2a-4f9f-a824-66604ac3f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a2d226-ef2a-4f9f-a824-66604ac3f61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0', 'volume_name': 'volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca34d004-079f-4fda-8f22-25df5047932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca34d004-079f-4fda-8f22-25df5047932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace045a2-3783-4260-8dcb-c71431cd5cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:31 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Volume 7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0', 'volume_size': 1} Jul 05 05:27:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:32 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.717s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:32 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:32 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:27:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:27:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:27:32 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 0 in 1.910s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:33 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:27:33 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:33 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c" returned: 0 in 5.721s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[13794f55-1295-4721-aa06-c090796ac245]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:33 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e Jul 05 05:27:33 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:34 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 1 in 1.046s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:34 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b Jul 05 05:27:34 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:34 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e" returned: 0 in 0.939s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:27:34 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Converted 1024.00 MB image at 178.94 MB/s Jul 05 05:27:34 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c is being set with open permissions: ugo+rw Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:34 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c Jul 05 05:27:34 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:34 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" returned: 0 in 0.674s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-quobyte-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b" released by "delete_volume" :: held 3.787s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:34 devstack cinder-volume[86688]: WARNING cinder.quota [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-841872427-1935559402 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-841872427-1935559402, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:27:34 devstack cinder-volume[86688]: WARNING cinder.quota [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-841872427-1935559402 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-841872427-1935559402, it is now deprecated. Please use the default quota class for default quota. Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Created reservations ['5bc41a33-7886-47b4-add0-df90e98fa3e6', 'abfa107e-549e-4f95-8a24-f6909810156a', 'd2698e28-547a-4d1c-af7a-3a439131eb79', '8e442d07-9fb9-4c24-a093-27b2857b81c4'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:34 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:34 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:35 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c" returned: 0 in 0.663s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-7736bf7a-1cb4-4268-b433-5368366c068c" released by "_copy_volume_from_snapshot" :: held 9.213s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-d63a2b4e-9b3f-4008-b2dd-b535b624aa66-7736bf7a-1cb4-4268-b433-5368366c068c" released by "_create_volume_from_snapshot" :: held 9.251s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.269s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.555s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce9ea6a81ea4fb38e3663ad3df0880d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:31Z,use_quota=True,user_id='2bf6c7601f794dcc8aeb5b67713305d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Creating volume 7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:27:35 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:35 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 1073741824 Jul 05 05:27:35 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c913c10b-b442-489a-aa2d-35cf5da17412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7736bf7a-1cb4-4268-b433-5368366c068c', 'volume_size': 1, 'snapshot_id': 'd63a2b4e-9b3f-4008-b2dd-b535b624aa66'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb77a4b-9b87-43ee-96b5-414a4a7bb790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Volume volume-7736bf7a-1cb4-4268-b433-5368366c068c (7736bf7a-1cb4-4268-b433-5368366c068c): created successfully Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb77a4b-9b87-43ee-96b5-414a4a7bb790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Flow 'volume_create_manager' (c2b777ec-dd56-4628-8ef4-c407347ec99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-320a2b5b-8508-4eeb-ad8d-475293cbc640 tempest-VolumeDependencyTests-809229378 None] Created volume successfully. Jul 05 05:27:35 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.856s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Deleted volume successfully. Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f04ae845-e0ca-4ab6-9812-ebc433646936 tempest-TestInstancesWithCinderVolumes-1265216336 None] Lock "cinder-9d19ad4c-cfa4-45a1-b485-4b2f46f7cb6b-delete_volume" released by "delete_volume" :: held 4.990s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-d63a2b4e-9b3f-4008-b2dd-b535b624aa66-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Lock "cinder-d63a2b4e-9b3f-4008-b2dd-b535b624aa66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-quobyte-217b392a-4c66-4340-8ca5-dca2d4d3425e" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-217b392a-4c66-4340-8ca5-dca2d4d3425e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-quobyte-d63a2b4e-9b3f-4008-b2dd-b535b624aa66" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-d63a2b4e-9b3f-4008-b2dd-b535b624aa66" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Deleting offline snapshot d63a2b4e-9b3f-4008-b2dd-b535b624aa66 of volume 217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] snapshot_file for this snap is: volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4492d67d-ea53-4832-a16a-845dc1452d1d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:36 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 Jul 05 05:27:36 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:36 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 1073741824" returned: 0 in 1.055s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:36 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 Jul 05 05:27:36 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:36 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66" returned: 0 in 0.865s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-217b392a-4c66-4340-8ca5-dca2d4d3425e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:27:36 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85afa9e-8925-43b0-9f8f-b7cd77a40993]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:37 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0" returned: 0 in 0.739s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:37 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e Jul 05 05:27:37 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace045a2-3783-4260-8dcb-c71431cd5cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682e7a7f-b9b6-4a85-b02b-ac0f1b74733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Volume volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 (7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0): created successfully Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682e7a7f-b9b6-4a85-b02b-ac0f1b74733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Flow 'volume_create_manager' (1be946c8-ab2b-41e9-8c56-c463dbe4e866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-23035137-adab-4ce5-b956-e1f6483b2c36 tempest-CinderUnicodeTest-1422953554 None] Created volume successfully. Jul 05 05:27:37 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e" returned: 0 in 0.945s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:37 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 Jul 05 05:27:37 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Flow 'volume_create_manager' (a79e8c89-f727-4112-8e82-fb109dde32cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469450d-912a-426e-8522-0e94c3bd1fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469450d-912a-426e-8522-0e94c3bd1fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1334600376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c599f7-840c-4ce4-937d-2256466066d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce9ea6a81ea4fb38e3663ad3df0880d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:38Z,use_quota=True,user_id='2bf6c7601f794dcc8aeb5b67713305d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea2e56a-88eb-4331-90b5-3d5e92963d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea2e56a-88eb-4331-90b5-3d5e92963d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f076c621-cd97-4fd6-a872-24094cf2da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f076c621-cd97-4fd6-a872-24094cf2da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c599f7-840c-4ce4-937d-2256466066d2', 'volume_name': 'volume-d0c599f7-840c-4ce4-937d-2256466066d2', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6575f926-0544-47d0-b510-ce95e43ebdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6575f926-0544-47d0-b510-ce95e43ebdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6884335c-b3f9-4a2f-9488-23a2697369e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Volume d0c599f7-840c-4ce4-937d-2256466066d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c599f7-840c-4ce4-937d-2256466066d2', 'volume_size': 1} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:27:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1334600376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c599f7-840c-4ce4-937d-2256466066d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce9ea6a81ea4fb38e3663ad3df0880d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:27:38Z,use_quota=True,user_id='2bf6c7601f794dcc8aeb5b67713305d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Creating volume d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:27:38 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:38 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 1073741824 Jul 05 05:27:38 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:38 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66" returned: 0 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:38 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66 Jul 05 05:27:38 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:39 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 1073741824" returned: 0 in 1.002s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:39 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e.d63a2b4e-9b3f-4008-b2dd-b535b624aa66" returned: 0 in 0.863s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:39 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 Jul 05 05:27:39 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-d63a2b4e-9b3f-4008-b2dd-b535b624aa66" released by "_delete_snapshot" :: held 3.612s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-217b392a-4c66-4340-8ca5-dca2d4d3425e" released by "delete_snapshot" :: held 3.653s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:39 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Created reservations ['fd56ff75-a4a6-4ff1-b82a-f2a839568f05', 'eb66de09-e13d-4d3c-992b-6627a3b567a0', '65163ddd-bfe6-4952-a3e9-c950d6acfd55', 'a87c59a2-f89b-4dfd-9372-7535a501c46d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Delete snapshot completed successfully. Jul 05 05:27:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ad256328-3260-455a-87f0-526cf25e6b8f tempest-VolumeDependencyTests-809229378 None] Lock "cinder-d63a2b4e-9b3f-4008-b2dd-b535b624aa66-delete_snapshot" released by "delete_snapshot" :: held 3.870s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-217b392a-4c66-4340-8ca5-dca2d4d3425e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-217b392a-4c66-4340-8ca5-dca2d4d3425e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:40 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2" returned: 0 in 0.786s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6884335c-b3f9-4a2f-9488-23a2697369e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c599f7-840c-4ce4-937d-2256466066d2', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407fd426-f059-47c4-aebf-a22525677653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-quobyte-217b392a-4c66-4340-8ca5-dca2d4d3425e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:40 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Volume volume-d0c599f7-840c-4ce4-937d-2256466066d2 (d0c599f7-840c-4ce4-937d-2256466066d2): created successfully Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407fd426-f059-47c4-aebf-a22525677653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Flow 'volume_create_manager' (a79e8c89-f727-4112-8e82-fb109dde32cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:27:40 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f5fb6725-2cc6-4b22-b6e9-73d385eab80d tempest-CinderUnicodeTest-1422953554 None] Created volume successfully. Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-217b392a-4c66-4340-8ca5-dca2d4d3425e" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f8767-307b-42b5-afc3-58601d529915]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:40 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e Jul 05 05:27:40 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Creating offline snapshot ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 of volume d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[464e0a98-10b8-4ec7-8c9b-5ff5c8402fee]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:40 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 Jul 05 05:27:40 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:41 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e" returned: 0 in 0.886s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:41 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e Jul 05 05:27:41 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:41 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2" returned: 0 in 0.874s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:41 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 1G Jul 05 05:27:41 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:41 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-217b392a-4c66-4340-8ca5-dca2d4d3425e" returned: 0 in 0.746s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-217b392a-4c66-4340-8ca5-dca2d4d3425e" released by "delete_volume" :: held 1.715s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Created reservations ['07f1146f-0b6f-4cf0-8298-ede3c6d86852', '129dfd41-f302-4c74-92ab-508e04a56845', 'dfd8ff7b-1da0-45cd-b9b3-89bbdab461fe', 'b52d71b5-e967-4f7b-ae51-bccc4338dcdf'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:42 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:42 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-7736bf7a-1cb4-4268-b433-5368366c068c-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Lock "cinder-7736bf7a-1cb4-4268-b433-5368366c068c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Acquiring lock "cinder-quobyte-7736bf7a-1cb4-4268-b433-5368366c068c" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-7736bf7a-1cb4-4268-b433-5368366c068c" acquired by "delete_volume" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[20526b3c-6e90-4b25-b847-796b6a89e410]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:42 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 1G" returned: 0 in 1.016s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c599f7-840c-4ce4-937d-2256466066d2 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:42 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c599f7-840c-4ce4-937d-2256466066d2 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 Jul 05 05:27:42 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:42 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c Jul 05 05:27:42 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:43 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.907s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:43 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:43 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Deleted volume successfully. Jul 05 05:27:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fe3a2e80-925f-438c-9e62-10f698a31343 tempest-VolumeDependencyTests-809229378 None] Lock "cinder-217b392a-4c66-4340-8ca5-dca2d4d3425e-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:43 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:43 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c" returned: 0 in 0.989s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c599f7-840c-4ce4-937d-2256466066d2 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" returned: 0 in 0.958s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:43 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 is being set with open permissions: ugo+rw Jul 05 05:27:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:43 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c Jul 05 05:27:43 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:43 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 Jul 05 05:27:43 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:44 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" returned: 0 in 0.743s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:44 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7736bf7a-1cb4-4268-b433-5368366c068c" returned: 0 in 0.781s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Lock "cinder-quobyte-7736bf7a-1cb4-4268-b433-5368366c068c" released by "delete_volume" :: held 1.842s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:44 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.info Jul 05 05:27:44 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Created reservations ['967b2743-9366-42d6-abe2-f58201bcb2ee', '7c235a4f-d12d-4bad-ba84-73b76e727763', '9bd401b0-1a64-48c7-bb72-e087e435bc53', '5a2aa0d0-1f79-4eca-a73d-975aba6803aa'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:44 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:44 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:45 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.info" returned: 0 in 0.881s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:45 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.info is being set with open permissions: ugo+rw Jul 05 05:27:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:45 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.info Jul 05 05:27:45 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:45 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.868s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:45 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:45 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Deleted volume successfully. Jul 05 05:27:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6f43a573-c70a-47eb-a990-87cfa379ebcb tempest-VolumeDependencyTests-809229378 None] Lock "cinder-7736bf7a-1cb4-4268-b433-5368366c068c-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:46 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.info" returned: 0 in 0.870s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.470s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-19e523c5-7aee-4676-996b-09132c963c5e tempest-CinderUnicodeTest-1422953554 None] Create snapshot completed successfully Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "cinder-ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "cinder-quobyte-d0c599f7-840c-4ce4-937d-2256466066d2" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-d0c599f7-840c-4ce4-937d-2256466066d2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "cinder-quobyte-ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Deleting offline snapshot ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 of volume d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] snapshot_file for this snap is: volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec44f19-ff9b-4501-8207-a7b4441e679f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:47 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 Jul 05 05:27:47 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:47 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0c599f7-840c-4ce4-937d-2256466066d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:27:48 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[622e7842-d6ed-4f80-a443-5932847e0d5c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:48 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 Jul 05 05:27:48 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:48 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2" returned: 0 in 0.855s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:48 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 Jul 05 05:27:48 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:49 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" returned: 0 in 0.815s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:49 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3 Jul 05 05:27:49 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:50 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2.ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" returned: 0 in 0.690s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3" released by "_delete_snapshot" :: held 3.252s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-d0c599f7-840c-4ce4-937d-2256466066d2" released by "delete_snapshot" :: held 3.274s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:50 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Created reservations ['bdb28c05-8f3d-4e71-85a3-07bde1db050d', '964635f6-62cb-4b39-826a-066e3d3f2703', 'd7591811-ed96-417b-a706-0a831fdee026', '4d603874-1969-4229-9df3-2bf6ad2fe1cf'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Delete snapshot completed successfully. Jul 05 05:27:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0a2bf2a9-4d06-44ea-bef7-7a55d8f468eb tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-ebd6d29a-f4b8-4c30-bab3-a18bb15ec5a3-delete_snapshot" released by "delete_snapshot" :: held 3.417s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "cinder-d0c599f7-840c-4ce4-937d-2256466066d2-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-d0c599f7-840c-4ce4-937d-2256466066d2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "cinder-quobyte-d0c599f7-840c-4ce4-937d-2256466066d2" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-d0c599f7-840c-4ce4-937d-2256466066d2" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de70a8-6230-48ba-86e5-71407300545c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:51 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 Jul 05 05:27:51 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:52 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2" returned: 0 in 0.876s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:52 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2 Jul 05 05:27:52 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:53 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d0c599f7-840c-4ce4-937d-2256466066d2" returned: 0 in 0.731s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-d0c599f7-840c-4ce4-937d-2256466066d2" released by "delete_volume" :: held 1.672s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Created reservations ['65e90ff7-3eb7-4bd3-b200-ef5f0c996c89', 'e2932de8-b86e-4097-8406-c4171aca498a', '8cb3694f-bff9-44e4-8905-93da36d4aca5', 'e0953c41-9de6-45a2-ae8c-c88f4ba8365a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:53 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:53 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "cinder-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "cinder-quobyte-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9f0758-8121-4ad0-92d1-5a1db7b325df]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:53 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 Jul 05 05:27:53 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:53 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.731s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:53 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Deleted volume successfully. Jul 05 05:27:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a63cfad2-8bc5-428a-aea0-71781d06463f tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-d0c599f7-840c-4ce4-937d-2256466066d2-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:54 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:54 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0 Jul 05 05:27:54 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:55 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-quobyte-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0" released by "delete_volume" :: held 1.647s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Created reservations ['56cac074-9b31-4c76-8e6f-ae93b0e7b44a', '70932b32-405d-47d1-8462-5023f0ad60de', 'c10c9409-8104-4459-aff8-bb7f8adb7448', '1e47a5b0-9117-43b1-a3a7-2715a2cc0a10'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:27:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:27:55 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:27:55 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:27:56 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 05 05:27:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.732s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:27:56 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:27:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Deleted volume successfully. Jul 05 05:27:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f104622f-9c6d-43d3-a34e-3014c240e8e1 tempest-CinderUnicodeTest-1422953554 None] Lock "cinder-7e70ef38-ace7-4fc1-a899-9ef72ed6d6b0-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (e74fd72b-81d5-4dc6-845d-1e3548719b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94612a9c-af57-4ec9-9672-15c32232c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94612a9c-af57-4ec9-9672-15c32232c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880672910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb228af2-37da-41de-8385-9d1d4191100b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:05Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b489e7-faff-4d09-8171-0dca3183752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b489e7-faff-4d09-8171-0dca3183752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b49ff1f-40bc-4977-b3c4-3488fbab4f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b49ff1f-40bc-4977-b3c4-3488fbab4f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb228af2-37da-41de-8385-9d1d4191100b', 'volume_name': 'volume-eb228af2-37da-41de-8385-9d1d4191100b', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d2e46e-73da-456b-8af8-8f3ffb26b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d2e46e-73da-456b-8af8-8f3ffb26b757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5edfb6-0af7-4e72-9c5c-712cfe29b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:04 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Volume eb228af2-37da-41de-8385-9d1d4191100b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb228af2-37da-41de-8385-9d1d4191100b', 'volume_size': 1} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880672910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb228af2-37da-41de-8385-9d1d4191100b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:05Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Creating volume eb228af2-37da-41de-8385-9d1d4191100b {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:28:04 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:28:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:04 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b 1073741824 Jul 05 05:28:04 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:05 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b 1073741824" returned: 0 in 0.937s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:05 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b Jul 05 05:28:05 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:06 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b" returned: 0 in 0.741s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:28:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5edfb6-0af7-4e72-9c5c-712cfe29b93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb228af2-37da-41de-8385-9d1d4191100b', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49f23cd-dc43-471c-8185-c74761b2d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Volume volume-eb228af2-37da-41de-8385-9d1d4191100b (eb228af2-37da-41de-8385-9d1d4191100b): created successfully Jul 05 05:28:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49f23cd-dc43-471c-8185-c74761b2d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (e74fd72b-81d5-4dc6-845d-1e3548719b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:06 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-df51250e-9e2f-40e6-af69-0f0fb681d17b tempest-ProjectReaderTests-1051040709 None] Created volume successfully. Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-eb228af2-37da-41de-8385-9d1d4191100b-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-eb228af2-37da-41de-8385-9d1d4191100b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-quobyte-eb228af2-37da-41de-8385-9d1d4191100b" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-eb228af2-37da-41de-8385-9d1d4191100b" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[663fc1a2-c8f9-4f5a-bed8-366e30921651]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:07 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b Jul 05 05:28:07 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:07 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b" returned: 0 in 0.794s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:07 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b Jul 05 05:28:07 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:08 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-eb228af2-37da-41de-8385-9d1d4191100b" returned: 0 in 0.656s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-eb228af2-37da-41de-8385-9d1d4191100b" released by "delete_volume" :: held 1.511s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Created reservations ['3e111fe6-6ad2-4d4e-9eef-18768cb24de0', '9d9ad6a4-623f-4d4d-aed5-dd249edd5b30', '49a36be1-b565-46e0-904b-9e1e6f97b69e', '9ddf69a5-dd21-4296-8635-e21e88fba21d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:08 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:28:08 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:09 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.725s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:28:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Deleted volume successfully. Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=86,cinder:INSERT=32,cinder:UPDATE=95,cinder:DELETE=10 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f6ee04f2-0de4-4bb6-9881-31a403548ab2 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-eb228af2-37da-41de-8385-9d1d4191100b-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=81,cinder:UPDATE=114,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (5641b813-2087-49cd-ab64-1378164ecb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ff6d28-f364-4198-8552-b216c055eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ff6d28-f364-4198-8552-b216c055eb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144400126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b773d5da-1ee1-43bb-9890-c901d9154716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:10Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e01ff7-1cb3-461b-8b7d-9f3a8fa54517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e01ff7-1cb3-461b-8b7d-9f3a8fa54517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe31edbf-a78a-4886-aaf8-62638221b346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe31edbf-a78a-4886-aaf8-62638221b346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b773d5da-1ee1-43bb-9890-c901d9154716', 'volume_name': 'volume-b773d5da-1ee1-43bb-9890-c901d9154716', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552263f2-d311-4a6c-96e1-6d802aab9102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552263f2-d311-4a6c-96e1-6d802aab9102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5dd17f-265e-4b1e-804a-b3858176b7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Volume b773d5da-1ee1-43bb-9890-c901d9154716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b773d5da-1ee1-43bb-9890-c901d9154716', 'volume_size': 1} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144400126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b773d5da-1ee1-43bb-9890-c901d9154716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:10Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Creating volume b773d5da-1ee1-43bb-9890-c901d9154716 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:28:09 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:28:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:09 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 1073741824 Jul 05 05:28:09 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:10 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 1073741824" returned: 0 in 0.855s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:10 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 Jul 05 05:28:10 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:11 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716" returned: 0 in 0.678s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5dd17f-265e-4b1e-804a-b3858176b7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b773d5da-1ee1-43bb-9890-c901d9154716', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c6ef0-47bb-4933-92e6-a86a3c1bab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Volume volume-b773d5da-1ee1-43bb-9890-c901d9154716 (b773d5da-1ee1-43bb-9890-c901d9154716): created successfully Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291c6ef0-47bb-4933-92e6-a86a3c1bab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (5641b813-2087-49cd-ab64-1378164ecb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4cd0d647-54b0-476d-a937-7e6592839aea tempest-ProjectReaderTests-1051040709 None] Created volume successfully. Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-b773d5da-1ee1-43bb-9890-c901d9154716-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Lock "cinder-b773d5da-1ee1-43bb-9890-c901d9154716-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-quobyte-b773d5da-1ee1-43bb-9890-c901d9154716" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-b773d5da-1ee1-43bb-9890-c901d9154716" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1f1082-4c28-49cc-a0fb-2ff9dcf00b5e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:12 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 Jul 05 05:28:12 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:12 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716" returned: 0 in 0.823s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:12 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716 Jul 05 05:28:12 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:13 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b773d5da-1ee1-43bb-9890-c901d9154716" returned: 0 in 0.682s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-b773d5da-1ee1-43bb-9890-c901d9154716" released by "delete_volume" :: held 1.549s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Created reservations ['ba72c32a-ffb3-4f17-b1af-2ca7c35c0a01', '6fec1dc4-c682-4ea7-ad35-94a1fccb0768', '2df80734-25a4-42ac-b36e-848c234ab3aa', '8a1ef21d-87f4-4aef-a9b6-55c5a2f50819'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:13 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:28:13 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:14 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.659s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:28:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Deleted volume successfully. Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-07092a45-99d7-492a-b854-5acb13c0eafb tempest-ProjectReaderTests-1051040709 None] Lock "cinder-b773d5da-1ee1-43bb-9890-c901d9154716-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (f3464f24-3c23-478b-903c-3e57f6c4ee4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b66d9-1812-4633-a1df-3bbff8b92b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b66d9-1812-4633-a1df-3bbff8b92b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232614804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf99ef8-23a6-46b3-9209-6748a947c1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:15Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43c01f-95d7-4b50-8a20-89b84ad1b299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43c01f-95d7-4b50-8a20-89b84ad1b299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f852e7-62fc-468e-a803-a62b0feda5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f852e7-62fc-468e-a803-a62b0feda5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf99ef8-23a6-46b3-9209-6748a947c1ce', 'volume_name': 'volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ed70a1-14ba-480f-934e-eca2201c39c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ed70a1-14ba-480f-934e-eca2201c39c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067cef7d-fd52-49e5-8b17-96d459b30ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:14 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Volume dcf99ef8-23a6-46b3-9209-6748a947c1ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce', 'volume_size': 1} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232614804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf99ef8-23a6-46b3-9209-6748a947c1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:15Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Creating volume dcf99ef8-23a6-46b3-9209-6748a947c1ce {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:28:14 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:28:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:14 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce 1073741824 Jul 05 05:28:14 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:15 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce 1073741824" returned: 0 in 0.854s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:15 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce Jul 05 05:28:15 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:16 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce" returned: 0 in 0.645s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067cef7d-fd52-49e5-8b17-96d459b30ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba92bcb-1c3d-4fee-8f82-a5dd3bcf5023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:16 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Volume volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce (dcf99ef8-23a6-46b3-9209-6748a947c1ce): created successfully Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba92bcb-1c3d-4fee-8f82-a5dd3bcf5023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (f3464f24-3c23-478b-903c-3e57f6c4ee4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:16 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-612ab356-01ac-4a6b-a566-df4e92048a9e tempest-ProjectReaderTests-1051040709 None] Created volume successfully. Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-dcf99ef8-23a6-46b3-9209-6748a947c1ce-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-dcf99ef8-23a6-46b3-9209-6748a947c1ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-quobyte-dcf99ef8-23a6-46b3-9209-6748a947c1ce" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-dcf99ef8-23a6-46b3-9209-6748a947c1ce" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d846b8-a8b4-415f-8b7b-f1e4bea8a567]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:16 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce Jul 05 05:28:16 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:17 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:17 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce Jul 05 05:28:17 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:18 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dcf99ef8-23a6-46b3-9209-6748a947c1ce" returned: 0 in 0.703s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-dcf99ef8-23a6-46b3-9209-6748a947c1ce" released by "delete_volume" :: held 1.514s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Created reservations ['ba61dcbf-0db8-4eeb-b5c7-8936db8c989e', 'f6a9d5d5-a31d-4f65-9c6f-8a194b779628', '9f0ba3a3-91c5-4779-a121-2627e2fed08b', '498c7b2a-354d-4b22-97dd-6b7e73a9fb2d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:18 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:28:18 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:19 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.736s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:28:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Deleted volume successfully. Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b346ebaa-7596-4e22-8e45-65b15133b5b0 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-dcf99ef8-23a6-46b3-9209-6748a947c1ce-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (6e3a69d7-45c8-4682-a5dc-ef9e58261ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1947b809-60a8-4d16-880d-c072c3786415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1947b809-60a8-4d16-880d-c072c3786415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224616911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3be487-15c3-40c7-ab80-5052e0a83e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:20Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd90a765-b09c-4ef5-907e-08cb24f2366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd90a765-b09c-4ef5-907e-08cb24f2366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204650a-f882-4df8-bdd1-e9a3d0214857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c204650a-f882-4df8-bdd1-e9a3d0214857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3be487-15c3-40c7-ab80-5052e0a83e1a', 'volume_name': 'volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad39131-c9b4-457f-9d5b-a0f08e129bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad39131-c9b4-457f-9d5b-a0f08e129bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87999d3f-533d-4924-9d29-9aa5d7ae6f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Volume 8c3be487-15c3-40c7-ab80-5052e0a83e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a', 'volume_size': 1} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224616911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3be487-15c3-40c7-ab80-5052e0a83e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e4f9b856695425cb5314b10bf8b0d69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:20Z,use_quota=True,user_id='32fb7e221e1d48fc916a35d97a069404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Creating volume 8c3be487-15c3-40c7-ab80-5052e0a83e1a {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:28:19 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:28:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:19 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a 1073741824 Jul 05 05:28:19 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:20 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a 1073741824" returned: 0 in 0.935s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:20 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a Jul 05 05:28:20 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:21 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a" returned: 0 in 0.684s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87999d3f-533d-4924-9d29-9aa5d7ae6f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ae668a-5958-44df-a537-19b6cf08ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:21 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Volume volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a (8c3be487-15c3-40c7-ab80-5052e0a83e1a): created successfully Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ae668a-5958-44df-a537-19b6cf08ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Flow 'volume_create_manager' (6e3a69d7-45c8-4682-a5dc-ef9e58261ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-72aabd2c-fea0-4f45-a223-5bd30508faad tempest-ProjectReaderTests-1051040709 None] Created volume successfully. Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-8c3be487-15c3-40c7-ab80-5052e0a83e1a-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-8c3be487-15c3-40c7-ab80-5052e0a83e1a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "cinder-quobyte-8c3be487-15c3-40c7-ab80-5052e0a83e1a" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-8c3be487-15c3-40c7-ab80-5052e0a83e1a" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1dedf1-01fc-4c8d-8f81-7973384e91f4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:21 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a Jul 05 05:28:21 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:22 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a" returned: 0 in 0.765s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:22 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a Jul 05 05:28:22 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:23 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8c3be487-15c3-40c7-ab80-5052e0a83e1a" returned: 0 in 0.952s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-quobyte-8c3be487-15c3-40c7-ab80-5052e0a83e1a" released by "delete_volume" :: held 1.775s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Created reservations ['7447f5e6-8890-4dc6-8142-29b3841c3e91', '9263120a-e313-45a1-854e-91c0140933d7', 'c36080b6-e22c-4763-a5bd-fa131278f274', 'ee1bc742-8a7a-4df9-87ce-dbb7b619e884'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:23 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:28:23 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:24 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.680s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:24 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:28:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Deleted volume successfully. Jul 05 05:28:24 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6a930d2b-b542-424f-8935-799da198db07 tempest-ProjectReaderTests-1051040709 None] Lock "cinder-8c3be487-15c3-40c7-ab80-5052e0a83e1a-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Flow 'volume_create_manager' (35612a45-8f1d-43c8-9235-d7e18bf6bdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967f6b5-c0a7-414b-88d5-7eceddcbd974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1967f6b5-c0a7-414b-88d5-7eceddcbd974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1635372054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a767e-69ca-4b1d-ba82-d5b1e02d2797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88046df78e340a0b1dce5be7b967d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:29Z,use_quota=True,user_id='9600bbe8d6644d5b9227cfe2c68ec297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eedcb11-f2d6-443f-84a9-0ae8daddf915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eedcb11-f2d6-443f-84a9-0ae8daddf915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026a8aaa-7d04-4171-bd54-54e94865b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026a8aaa-7d04-4171-bd54-54e94865b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9a767e-69ca-4b1d-ba82-d5b1e02d2797', 'volume_name': 'volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e311c3-204a-464f-90ce-7f91566c0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e311c3-204a-464f-90ce-7f91566c0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7344215-a4f5-478c-bafb-c88c303bc52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:28 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Volume cd9a767e-69ca-4b1d-ba82-d5b1e02d2797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797', 'volume_size': 1} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1635372054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9a767e-69ca-4b1d-ba82-d5b1e02d2797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88046df78e340a0b1dce5be7b967d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:29Z,use_quota=True,user_id='9600bbe8d6644d5b9227cfe2c68ec297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Creating volume cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:28:28 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:28:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:29 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 1073741824 Jul 05 05:28:29 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:29 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 1073741824" returned: 0 in 0.933s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:30 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 Jul 05 05:28:30 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:30 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:28:30 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:30 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7344215-a4f5-478c-bafb-c88c303bc52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e27eadd-a71c-47f8-b374-ba18b438c27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:30 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Volume volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 (cd9a767e-69ca-4b1d-ba82-d5b1e02d2797): created successfully Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e27eadd-a71c-47f8-b374-ba18b438c27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Flow 'volume_create_manager' (35612a45-8f1d-43c8-9235-d7e18bf6bdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-2a8acd12-5f1b-4b17-89af-c3268dc5e88a tempest-TestMinimumBasicScenario-254088753 None] Created volume successfully. Jul 05 05:28:31 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.956s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:28:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:28:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:28:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:28:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-34e951c5-93ae-4730-bf7f-53ac21fb0675 req-58205188-1511-4e9b-a59f-3599b4cd629c tempest-TestMinimumBasicScenario-254088753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-34e951c5-93ae-4730-bf7f-53ac21fb0675 req-58205188-1511-4e9b-a59f-3599b4cd629c tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:34 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3091c43-d799-43da-aeb0-0660054d9f6d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-34e951c5-93ae-4730-bf7f-53ac21fb0675 req-58205188-1511-4e9b-a59f-3599b4cd629c tempest-TestMinimumBasicScenario-254088753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:34 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 Jul 05 05:28:34 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:36 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-34e951c5-93ae-4730-bf7f-53ac21fb0675 req-58205188-1511-4e9b-a59f-3599b4cd629c tempest-TestMinimumBasicScenario-254088753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797" returned: 0 in 1.265s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-34e951c5-93ae-4730-bf7f-53ac21fb0675 req-58205188-1511-4e9b-a59f-3599b4cd629c tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.291s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-34e951c5-93ae-4730-bf7f-53ac21fb0675 req-58205188-1511-4e9b-a59f-3599b4cd629c tempest-TestMinimumBasicScenario-254088753 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75996ed7-f895-4960-a619-f2763cba8566', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:28:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-34e951c5-93ae-4730-bf7f-53ac21fb0675 req-58205188-1511-4e9b-a59f-3599b4cd629c tempest-TestMinimumBasicScenario-254088753 None] attachment_update completed successfully. Jul 05 05:28:46 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=36,cinder:DELETE=3,cinder:SELECT=29,cinder:INSERT=8 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:28:46 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=29,cinder:INSERT=8,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Flow 'volume_create_manager' (0d15de3f-e897-4aa5-b4ae-91da54d75e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b62a6b-163b-41da-9b58-41a883d3d395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b62a6b-163b-41da-9b58-41a883d3d395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2004677182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1114cced-48a0-41a3-8537-cf07c8b7aa28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2b1c97a3ca4f6d9e25d6b1a80cf78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:50Z,use_quota=True,user_id='d1917991ae3f4a8892306c0a3880113b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bfbb97-adcf-49bd-a1da-0c89489de34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1bfbb97-adcf-49bd-a1da-0c89489de34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c3452c-1eaa-4b6b-b6be-74efca396124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c3452c-1eaa-4b6b-b6be-74efca396124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1114cced-48a0-41a3-8537-cf07c8b7aa28', 'volume_name': 'volume-1114cced-48a0-41a3-8537-cf07c8b7aa28', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f711dfcf-f9d1-4150-b0c3-f9ba20afd7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f711dfcf-f9d1-4150-b0c3-f9ba20afd7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e8a5c1-424e-46ea-80b3-495fb1dc1306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Volume 1114cced-48a0-41a3-8537-cf07c8b7aa28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1114cced-48a0-41a3-8537-cf07c8b7aa28', 'volume_size': 1} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2004677182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1114cced-48a0-41a3-8537-cf07c8b7aa28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2b1c97a3ca4f6d9e25d6b1a80cf78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:50Z,use_quota=True,user_id='d1917991ae3f4a8892306c0a3880113b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Creating volume 1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:28:50 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:28:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:50 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 1073741824 Jul 05 05:28:50 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:51 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 1073741824" returned: 0 in 0.824s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:51 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 Jul 05 05:28:51 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:52 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28" returned: 0 in 0.645s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e8a5c1-424e-46ea-80b3-495fb1dc1306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1114cced-48a0-41a3-8537-cf07c8b7aa28', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0e23e-db8e-42d4-a3a6-db36de5818f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:52 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Volume volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 (1114cced-48a0-41a3-8537-cf07c8b7aa28): created successfully Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b0e23e-db8e-42d4-a3a6-db36de5818f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Flow 'volume_create_manager' (0d15de3f-e897-4aa5-b4ae-91da54d75e26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9fd91f00-d5be-4ce3-b756-16df243b52a1 tempest-SnapshotDependencyTests-1419434714 None] Created volume successfully. Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Creating offline snapshot 70dc8277-1516-4b10-904b-9d2db8982443 of volume 1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c064bb0-3c04-491e-9923-3c391f28cd6d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:52 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 Jul 05 05:28:52 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:53 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28" returned: 0 in 0.815s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:53 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 1G Jul 05 05:28:53 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:54 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 1G" returned: 0 in 0.837s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:54 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 Jul 05 05:28:54 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:55 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443" returned: 0 in 0.725s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:55 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 is being set with open permissions: ugo+rw Jul 05 05:28:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:55 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 Jul 05 05:28:55 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:55 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443" returned: 0 in 0.681s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:55 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.info Jul 05 05:28:55 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:56 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.info" returned: 0 in 0.655s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:56 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.info is being set with open permissions: ugo+rw Jul 05 05:28:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:56 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.info Jul 05 05:28:56 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:57 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.info" returned: 0 in 0.643s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.450s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:57 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8a322cc6-316a-4b31-9c98-3603195dd3b8 tempest-SnapshotDependencyTests-1419434714 None] Create snapshot completed successfully Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Flow 'volume_create_manager' (fb20f818-4865-4b64-8f79-1258bacc3f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9a8dcb-725c-4c26-b832-21d538b4c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9a8dcb-725c-4c26-b832-21d538b4c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277e6d7b-ec8a-40ad-b48f-930d841ec61c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2b1c97a3ca4f6d9e25d6b1a80cf78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=70dc8277-1516-4b10-904b-9d2db8982443,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:28:59Z,use_quota=True,user_id='d1917991ae3f4a8892306c0a3880113b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79c0100-41f0-4830-8c3a-5150b76bf757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79c0100-41f0-4830-8c3a-5150b76bf757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2844c3-fb1e-4d09-aeac-536af0c9b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2844c3-fb1e-4d09-aeac-536af0c9b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '277e6d7b-ec8a-40ad-b48f-930d841ec61c', 'volume_name': 'volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c', 'volume_size': 1, 'snapshot_id': '70dc8277-1516-4b10-904b-9d2db8982443'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d286196-3e67-474c-af01-6db819e9d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d286196-3e67-474c-af01-6db819e9d442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9433f72e-402d-4132-a2e8-bccefef2a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:28:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Volume 277e6d7b-ec8a-40ad-b48f-930d841ec61c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c', 'volume_size': 1, 'snapshot_id': '70dc8277-1516-4b10-904b-9d2db8982443'} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-quobyte-70dc8277-1516-4b10-904b-9d2db8982443-277e6d7b-ec8a-40ad-b48f-930d841ec61c" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-70dc8277-1516-4b10-904b-9d2db8982443-277e6d7b-ec8a-40ad-b48f-930d841ec61c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Creating volume 277e6d7b-ec8a-40ad-b48f-930d841ec61c from snapshot 70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-quobyte-277e6d7b-ec8a-40ad-b48f-930d841ec61c" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-277e6d7b-ec8a-40ad-b48f-930d841ec61c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] snapshot: 70dc8277-1516-4b10-904b-9d2db8982443, volume: 277e6d7b-ec8a-40ad-b48f-930d841ec61c, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae25e680-1bb9-406e-86f4-eff15ff5f1db]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:58 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 Jul 05 05:28:58 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:28:59 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Jul 05 05:28:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443" returned: 0 in 0.757s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:28:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1114cced-48a0-41a3-8537-cf07c8b7aa28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:28:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:28:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:28:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffee6830-2904-44d1-ab6c-b4734a8d85b1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:28:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:28:59 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 Jul 05 05:28:59 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:00 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:00 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:29:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:00 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c Jul 05 05:29:00 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:05 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c" returned: 0 in 5.250s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b11b94-cef4-43b1-a176-3dda629d1cef]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:29:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:05 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 Jul 05 05:29:05 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:06 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28" returned: 0 in 0.934s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:06 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:29:06 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Converted 1024.00 MB image at 194.99 MB/s Jul 05 05:29:06 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c is being set with open permissions: ugo+rw Jul 05 05:29:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:06 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c Jul 05 05:29:06 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:07 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c" returned: 0 in 0.660s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-277e6d7b-ec8a-40ad-b48f-930d841ec61c" released by "_copy_volume_from_snapshot" :: held 8.465s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-70dc8277-1516-4b10-904b-9d2db8982443-277e6d7b-ec8a-40ad-b48f-930d841ec61c" released by "_create_volume_from_snapshot" :: held 8.497s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.515s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9433f72e-402d-4132-a2e8-bccefef2a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c', 'volume_size': 1, 'snapshot_id': '70dc8277-1516-4b10-904b-9d2db8982443'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0915f538-9a4d-448d-967b-ac1e2defc298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:29:07 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Volume volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c (277e6d7b-ec8a-40ad-b48f-930d841ec61c): created successfully Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0915f538-9a4d-448d-967b-ac1e2defc298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:29:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Flow 'volume_create_manager' (fb20f818-4865-4b64-8f79-1258bacc3f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:29:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-016378ef-3820-4528-adad-412e333ddf92 tempest-SnapshotDependencyTests-1419434714 None] Created volume successfully. Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-70dc8277-1516-4b10-904b-9d2db8982443-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-70dc8277-1516-4b10-904b-9d2db8982443-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-quobyte-1114cced-48a0-41a3-8537-cf07c8b7aa28" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-1114cced-48a0-41a3-8537-cf07c8b7aa28" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-quobyte-70dc8277-1516-4b10-904b-9d2db8982443" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-70dc8277-1516-4b10-904b-9d2db8982443" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Deleting offline snapshot 70dc8277-1516-4b10-904b-9d2db8982443 of volume 1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] snapshot_file for this snap is: volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed5168a-dd8a-442f-a1a6-bf1424a86062]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:29:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:08 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 Jul 05 05:29:08 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:09 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443" returned: 0 in 0.758s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1114cced-48a0-41a3-8537-cf07c8b7aa28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:29:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7570cd-7366-4edd-aac0-bfa930ab2bee]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:29:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:09 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 Jul 05 05:29:09 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:10 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28" returned: 0 in 0.768s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:10 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 Jul 05 05:29:10 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:10 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443" returned: 0 in 0.717s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:10 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443 Jul 05 05:29:10 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:11 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28.70dc8277-1516-4b10-904b-9d2db8982443" returned: 0 in 0.636s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-70dc8277-1516-4b10-904b-9d2db8982443" released by "_delete_snapshot" :: held 2.985s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-1114cced-48a0-41a3-8537-cf07c8b7aa28" released by "delete_snapshot" :: held 3.006s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:11 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Created reservations ['d5046442-7da5-4248-aa5b-c7237a7b92fb', '402ea16b-68be-4c87-9c94-ee36a1d22d42', '84b472ca-6613-4f45-ba1e-0e0431c516dc', '4bfa608d-3c5d-4afe-a0fc-bf71f513a00b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:29:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Delete snapshot completed successfully. Jul 05 05:29:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b01709c3-2b44-4dc1-9b47-bf369b3207df tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-70dc8277-1516-4b10-904b-9d2db8982443-delete_snapshot" released by "delete_snapshot" :: held 3.177s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-1114cced-48a0-41a3-8537-cf07c8b7aa28-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-1114cced-48a0-41a3-8537-cf07c8b7aa28-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-quobyte-1114cced-48a0-41a3-8537-cf07c8b7aa28" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-1114cced-48a0-41a3-8537-cf07c8b7aa28" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5710b02-502c-44dd-9189-36c860314148]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:29:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:12 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 Jul 05 05:29:12 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:13 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28" returned: 0 in 0.762s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:13 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28 Jul 05 05:29:13 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:14 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1114cced-48a0-41a3-8537-cf07c8b7aa28" returned: 0 in 0.663s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-1114cced-48a0-41a3-8537-cf07c8b7aa28" released by "delete_volume" :: held 1.494s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Created reservations ['88cf6a18-ab5c-4de6-8e40-9d7caffd60c2', '53015e3c-6869-452a-a964-ca8b782bc686', 'c43c88cd-ca9e-46f8-87f8-ef006e13a15a', 'cf54ab44-2d91-46dc-a1ba-be12c46aa528'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:14 devstack sudo[103677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:29:14 devstack sudo[103677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-277e6d7b-ec8a-40ad-b48f-930d841ec61c-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-277e6d7b-ec8a-40ad-b48f-930d841ec61c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "cinder-quobyte-277e6d7b-ec8a-40ad-b48f-930d841ec61c" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-277e6d7b-ec8a-40ad-b48f-930d841ec61c" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1114cf-a124-4a4e-9fa6-f73e36122d04]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:15 devstack sudo[103677]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.691s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:29:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Deleted volume successfully. Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8c77fa01-3a2c-4b8a-8d13-da2d93600556 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-1114cced-48a0-41a3-8537-cf07c8b7aa28-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:15 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c Jul 05 05:29:15 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:15 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c" returned: 0 in 0.769s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:15 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c Jul 05 05:29:15 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:16 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-277e6d7b-ec8a-40ad-b48f-930d841ec61c" returned: 0 in 0.670s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-quobyte-277e6d7b-ec8a-40ad-b48f-930d841ec61c" released by "delete_volume" :: held 1.482s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Created reservations ['d14854bf-debd-41dd-a3d6-888fd4eed807', 'fa5831b4-f5a0-4ce2-8eb8-7e87f8a93585', 'ba042882-3c4e-4634-87e9-71eb3cdfa7f9', '89e879f8-9c3b-4a87-9248-d10fe3adaed4'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:29:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:16 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:29:16 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:17 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.667s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:17 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:29:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Deleted volume successfully. Jul 05 05:29:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45d51d18-88d9-4bc4-9863-abe2a7f590d5 tempest-SnapshotDependencyTests-1419434714 None] Lock "cinder-277e6d7b-ec8a-40ad-b48f-930d841ec61c-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:26 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=19,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:29:27 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:29:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-c41190b7-3790-4f2f-a19b-cf6a08d7b9b1 req-08c4c891-0a4b-4bda-82d1-5bb40eae15e7 tempest-TestMinimumBasicScenario-254088753 None] Terminate volume connection completed successfully. Jul 05 05:29:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-c41190b7-3790-4f2f-a19b-cf6a08d7b9b1 req-08c4c891-0a4b-4bda-82d1-5bb40eae15e7 tempest-TestMinimumBasicScenario-254088753 None] Deleting attachment 75996ed7-f895-4960-a619-f2763cba8566. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:30 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:29:30 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Acquiring lock "cinder-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Lock "cinder-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Acquiring lock "cinder-quobyte-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Lock "cinder-quobyte-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797" acquired by "delete_volume" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eed598-f372-470c-8c09-0175cdd53e5a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:31 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 Jul 05 05:29:31 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:31 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.665s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:29:31 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:31 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797 Jul 05 05:29:31 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:32 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797" returned: 0 in 0.647s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Lock "cinder-quobyte-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797" released by "delete_volume" :: held 1.458s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Created reservations ['6094613e-9ccf-4559-a4ef-4500ec6863e0', 'a36fc706-2674-4a71-a34e-4c66253c2774', '24dbeff4-ba87-4097-9c51-bcb1f19ae62f', '038707c8-89fa-4ddc-9b99-248294a3fae2'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:29:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:29:32 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:29:32 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:29:33 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 05 05:29:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.653s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:29:33 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:29:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Deleted volume successfully. Jul 05 05:29:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9e97a072-109e-4313-a639-09b2b7140657 tempest-TestMinimumBasicScenario-254088753 None] Lock "cinder-cd9a767e-69ca-4b1d-ba82-d5b1e02d2797-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:29:42 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:29:43 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Flow 'volume_create_manager' (1cad313e-8478-4e55-8412-3d258cac9903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930495d3-7545-4b6e-953b-142fed93f66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930495d3-7545-4b6e-953b-142fed93f66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1511690340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028d7859-7466-4baf-a0d0-adb303c5f101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ac115f1344122b4b764788fc08140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:30:10Z,use_quota=True,user_id='843a7566011e453d8d1b87e8dd51f39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8add5b12-fea5-4fbe-9112-6e2deee60329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8add5b12-fea5-4fbe-9112-6e2deee60329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ec9a79-6528-446e-a066-e7ca6134288e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ec9a79-6528-446e-a066-e7ca6134288e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028d7859-7466-4baf-a0d0-adb303c5f101', 'volume_name': 'volume-028d7859-7466-4baf-a0d0-adb303c5f101', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5695f506-56af-4bf7-8f00-129b7f0bad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5695f506-56af-4bf7-8f00-129b7f0bad7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b190cb-9859-4810-ac08-6338d2ebb811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Volume 028d7859-7466-4baf-a0d0-adb303c5f101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028d7859-7466-4baf-a0d0-adb303c5f101', 'volume_size': 1} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1511690340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028d7859-7466-4baf-a0d0-adb303c5f101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ac115f1344122b4b764788fc08140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:30:10Z,use_quota=True,user_id='843a7566011e453d8d1b87e8dd51f39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Creating volume 028d7859-7466-4baf-a0d0-adb303c5f101 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:30:09 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:30:09 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 1073741824 Jul 05 05:30:09 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Flow 'volume_create_manager' (e030fdc4-2d27-4679-88fa-d77bf8c20359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:30:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414f3a5b-e687-488a-a021-9187877a79c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414f3a5b-e687-488a-a021-9187877a79c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1014335873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8360478b-149a-49da-91e3-a9386d5c5973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ac115f1344122b4b764788fc08140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:30:10Z,use_quota=True,user_id='843a7566011e453d8d1b87e8dd51f39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e2ce2c-3ef1-4c02-9106-fbc3e266d203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e2ce2c-3ef1-4c02-9106-fbc3e266d203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af296d0-eefc-489a-967f-0bfdaf1d1dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af296d0-eefc-489a-967f-0bfdaf1d1dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8360478b-149a-49da-91e3-a9386d5c5973', 'volume_name': 'volume-8360478b-149a-49da-91e3-a9386d5c5973', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f8d9e5-ca24-470f-b3a2-80c5ad381ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f8d9e5-ca24-470f-b3a2-80c5ad381ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69f956d-b1a4-4712-b34f-cf044f33864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:10 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Volume 8360478b-149a-49da-91e3-a9386d5c5973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8360478b-149a-49da-91e3-a9386d5c5973', 'volume_size': 1} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:30:10 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 1073741824" returned: 0 in 0.900s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:30:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:30:10 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 Jul 05 05:30:10 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:30:11 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101" returned: 0 in 0.653s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1014335873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8360478b-149a-49da-91e3-a9386d5c5973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11ac115f1344122b4b764788fc08140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:30:10Z,use_quota=True,user_id='843a7566011e453d8d1b87e8dd51f39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Creating volume 8360478b-149a-49da-91e3-a9386d5c5973 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:30:11 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b190cb-9859-4810-ac08-6338d2ebb811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028d7859-7466-4baf-a0d0-adb303c5f101', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:11 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 1073741824 Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4df431-85d8-4afc-8123-b3a49a1f3363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:11 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:30:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Volume volume-028d7859-7466-4baf-a0d0-adb303c5f101 (028d7859-7466-4baf-a0d0-adb303c5f101): created successfully Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4df431-85d8-4afc-8123-b3a49a1f3363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Flow 'volume_create_manager' (1cad313e-8478-4e55-8412-3d258cac9903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:30:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6ef0d309-02c5-4948-be5b-72daf945520d tempest-TestServerVolumeAttachmentScenario-1903390911 None] Created volume successfully. Jul 05 05:30:12 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 1073741824" returned: 0 in 0.906s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:30:12 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 Jul 05 05:30:12 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:30:12 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973" returned: 0 in 0.684s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69f956d-b1a4-4712-b34f-cf044f33864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8360478b-149a-49da-91e3-a9386d5c5973', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b09dd-d8a2-475a-90c1-222f1079d7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:30:12 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Volume volume-8360478b-149a-49da-91e3-a9386d5c5973 (8360478b-149a-49da-91e3-a9386d5c5973): created successfully Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743b09dd-d8a2-475a-90c1-222f1079d7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:30:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Flow 'volume_create_manager' (e030fdc4-2d27-4679-88fa-d77bf8c20359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:30:12 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-cb9b3916-497c-45fc-852b-d2c37ca53e5b tempest-TestServerVolumeAttachmentScenario-1903390911 None] Created volume successfully. Jul 05 05:30:22 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:30:22 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:30:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:30:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:30:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:30:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:30:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:30:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:30:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:30:30 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:30:30 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:30:31 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jul 05 05:30:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.626s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:30:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:30:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:30:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:30:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:30:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:30:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:30:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-f285fb58-f5cb-4709-adf1-4afc11b258db req-6a17fbe4-1760-493c-a8bc-eba7ec2cbce9 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:30:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-f285fb58-f5cb-4709-adf1-4afc11b258db req-6a17fbe4-1760-493c-a8bc-eba7ec2cbce9 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:30:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[83343ff0-c4a9-4a1a-bc71-209ce7c08dca]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:30:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-f285fb58-f5cb-4709-adf1-4afc11b258db req-6a17fbe4-1760-493c-a8bc-eba7ec2cbce9 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:30:51 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 Jul 05 05:30:51 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:30:51 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jul 05 05:30:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-f285fb58-f5cb-4709-adf1-4afc11b258db req-6a17fbe4-1760-493c-a8bc-eba7ec2cbce9 tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101" returned: 0 in 0.761s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:30:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-f285fb58-f5cb-4709-adf1-4afc11b258db req-6a17fbe4-1760-493c-a8bc-eba7ec2cbce9 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:30:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-f285fb58-f5cb-4709-adf1-4afc11b258db req-6a17fbe4-1760-493c-a8bc-eba7ec2cbce9 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-028d7859-7466-4baf-a0d0-adb303c5f101', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40a4d55a-e984-47b4-b426-2026a5875e69', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:30:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-f285fb58-f5cb-4709-adf1-4afc11b258db req-6a17fbe4-1760-493c-a8bc-eba7ec2cbce9 tempest-TestServerVolumeAttachmentScenario-1903390911 None] attachment_update completed successfully. Jul 05 05:31:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-60a47c50-82e7-46ac-b4a0-b37905885396 req-5eb538fc-3a9e-4300-9742-dd1ef92de42c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-60a47c50-82e7-46ac-b4a0-b37905885396 req-5eb538fc-3a9e-4300-9742-dd1ef92de42c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d1871a-c3e9-4cdb-8574-2353befd47bb]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-60a47c50-82e7-46ac-b4a0-b37905885396 req-5eb538fc-3a9e-4300-9742-dd1ef92de42c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:00 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 Jul 05 05:31:00 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:01 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [req-60a47c50-82e7-46ac-b4a0-b37905885396 req-5eb538fc-3a9e-4300-9742-dd1ef92de42c tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973" returned: 0 in 0.777s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [req-60a47c50-82e7-46ac-b4a0-b37905885396 req-5eb538fc-3a9e-4300-9742-dd1ef92de42c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.793s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-60a47c50-82e7-46ac-b4a0-b37905885396 req-5eb538fc-3a9e-4300-9742-dd1ef92de42c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64', 'name': 'volume-8360478b-149a-49da-91e3-a9386d5c5973', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cfeb824-8fdc-40ac-bdb3-392ca96d6309', 'enforce_multipath': True} {{(pid=86688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 05:31:01 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-60a47c50-82e7-46ac-b4a0-b37905885396 req-5eb538fc-3a9e-4300-9742-dd1ef92de42c tempest-TestServerVolumeAttachmentScenario-1903390911 None] attachment_update completed successfully. Jul 05 05:31:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-c017d243-d999-48ca-938c-1ed9dcf3f882 req-dde34ecf-570c-42d0-93a9-7a77c0a6af52 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Terminate volume connection completed successfully. Jul 05 05:31:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-c017d243-d999-48ca-938c-1ed9dcf3f882 req-dde34ecf-570c-42d0-93a9-7a77c0a6af52 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Deleting attachment 7cfeb824-8fdc-40ac-bdb3-392ca96d6309. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:31:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [req-81290945-d2f0-4c2b-be1d-01af386315ed req-bfbe74cb-4e57-4dfc-85e7-3a12604a86bf tempest-TestServerVolumeAttachmentScenario-1903390911 None] Terminate volume connection completed successfully. Jul 05 05:31:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [req-81290945-d2f0-4c2b-be1d-01af386315ed req-bfbe74cb-4e57-4dfc-85e7-3a12604a86bf tempest-TestServerVolumeAttachmentScenario-1903390911 None] Deleting attachment 40a4d55a-e984-47b4-b426-2026a5875e69. {{(pid=86688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "cinder-8360478b-149a-49da-91e3-a9386d5c5973-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-8360478b-149a-49da-91e3-a9386d5c5973-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "cinder-quobyte-8360478b-149a-49da-91e3-a9386d5c5973" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-quobyte-8360478b-149a-49da-91e3-a9386d5c5973" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db283a-81d5-4d4d-a2f8-acb851e66de6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:21 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 Jul 05 05:31:21 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:21 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973" returned: 0 in 0.743s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:21 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973 Jul 05 05:31:21 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:22 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8360478b-149a-49da-91e3-a9386d5c5973" returned: 0 in 0.662s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-quobyte-8360478b-149a-49da-91e3-a9386d5c5973" released by "delete_volume" :: held 1.444s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Created reservations ['71dde579-9bca-4850-9632-f9bd198c0edf', 'd8637d7d-7a1f-4776-9e39-3bd1f0c60087', 'a337264b-5224-4b94-8ff1-cc7c09989c54', '4340f79a-cb51-46be-93b2-624a1f58ca33'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:22 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:22 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "cinder-028d7859-7466-4baf-a0d0-adb303c5f101-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-028d7859-7466-4baf-a0d0-adb303c5f101-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "cinder-quobyte-028d7859-7466-4baf-a0d0-adb303c5f101" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:23 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.665s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Deleted volume successfully. Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-quobyte-028d7859-7466-4baf-a0d0-adb303c5f101" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-7a262121-e76c-4e87-ab76-8616e02bf96c tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-8360478b-149a-49da-91e3-a9386d5c5973-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c97337c-f0c2-4801-a838-f0b95173fb2f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:23 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 Jul 05 05:31:23 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:23 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101" returned: 0 in 0.746s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:24 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101 Jul 05 05:31:24 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:24 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-028d7859-7466-4baf-a0d0-adb303c5f101" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-quobyte-028d7859-7466-4baf-a0d0-adb303c5f101" released by "delete_volume" :: held 1.424s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Created reservations ['a538f015-0c92-409f-93d1-bb66780ca550', 'd8b020f0-2032-4eae-8bd5-69695f2d4ded', '9877518a-6882-4988-8338-e0edfc4fb709', '30b98037-4030-4833-9b68-4adc7c81fe5c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:24 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:24 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:25 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.669s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:25 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:25 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Deleted volume successfully. Jul 05 05:31:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-99463ea8-6e46-4a32-b5d4-8535cc665829 tempest-TestServerVolumeAttachmentScenario-1903390911 None] Lock "cinder-028d7859-7466-4baf-a0d0-adb303c5f101-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:31:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:30 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:30 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:31 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.706s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:31:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:31:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (8336fcd5-ab4b-4f8c-ae9e-5749afb3c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce4deb0-d301-4268-85ad-12c11fc77fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce4deb0-d301-4268-85ad-12c11fc77fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-330009752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:35Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb8e564-bbf0-4abc-8c66-c47975853d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb8e564-bbf0-4abc-8c66-c47975853d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3176f275-a88d-42b2-bafb-142aec9c538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3176f275-a88d-42b2-bafb-142aec9c538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf', 'volume_name': 'volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a00e0c-5cad-4d98-8c19-72289ad43573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a00e0c-5cad-4d98-8c19-72289ad43573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1ca42b-168a-4749-87f7-ed91de95aaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:34 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Volume 7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf', 'volume_size': 1} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-330009752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:35Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Creating volume 7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:31:34 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:31:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:34 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf 1073741824 Jul 05 05:31:34 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (fde7b697-7444-4e3d-a8d2-1f2ec3650b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0bfb22-cf63-43bc-9e05-7d686a2559ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0bfb22-cf63-43bc-9e05-7d686a2559ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600058848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b667681f-ef95-4060-8079-409608163ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:35Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f402dfff-ef63-4d9f-90d7-8787ada403bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f402dfff-ef63-4d9f-90d7-8787ada403bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ae6379-25a9-4595-a4b1-3745c0c1bb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ae6379-25a9-4595-a4b1-3745c0c1bb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b667681f-ef95-4060-8079-409608163ef0', 'volume_name': 'volume-b667681f-ef95-4060-8079-409608163ef0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cd7a8f-c3fd-455b-8251-6f02dab264df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63cd7a8f-c3fd-455b-8251-6f02dab264df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5e1240-efe3-48d1-b99e-6f2c5e3ff039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Volume b667681f-ef95-4060-8079-409608163ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b667681f-ef95-4060-8079-409608163ef0', 'volume_size': 1} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (cfb495dd-d6d1-4fce-8353-366b349060f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef47f8f-4677-4d34-8bdb-7714eff2a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef47f8f-4677-4d34-8bdb-7714eff2a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2046566425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3795a7d-aa59-4466-98ea-c6d4d9f9e001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:35Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b130853-d1c0-4176-a4a9-3992370f780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b130853-d1c0-4176-a4a9-3992370f780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f583485b-ffed-4457-8a3f-d9d920316fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f583485b-ffed-4457-8a3f-d9d920316fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3795a7d-aa59-4466-98ea-c6d4d9f9e001', 'volume_name': 'volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d531f68c-8352-4455-b642-ba77da5e032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d531f68c-8352-4455-b642-ba77da5e032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2228196-b835-4170-a945-8c6ddac9f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Volume f3795a7d-aa59-4466-98ea-c6d4d9f9e001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001', 'volume_size': 1} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:35 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf 1073741824" returned: 0 in 0.887s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (c32e65b3-23d4-4254-af43-6a13f8832921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e43fc94-5788-48af-8dba-5976c8cb7fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e43fc94-5788-48af-8dba-5976c8cb7fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1976842651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42223d3c-a5f7-4154-aaae-56d975c6d31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:36Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4af4178-7dd3-4099-a3c5-fb5c27b2265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4af4178-7dd3-4099-a3c5-fb5c27b2265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486de906-6462-411e-8fac-5a41f0d84f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486de906-6462-411e-8fac-5a41f0d84f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42223d3c-a5f7-4154-aaae-56d975c6d31e', 'volume_name': 'volume-42223d3c-a5f7-4154-aaae-56d975c6d31e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfae68b-8b7c-43bf-9ee1-0a16c54f4fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfae68b-8b7c-43bf-9ee1-0a16c54f4fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fae3a9e-dba0-438f-b3c3-5f670fe4e376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Volume 42223d3c-a5f7-4154-aaae-56d975c6d31e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42223d3c-a5f7-4154-aaae-56d975c6d31e', 'volume_size': 1} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:35 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf Jul 05 05:31:35 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (26e58aa8-9752-4ea8-a8fd-65a9c92fa0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af29b6-7b74-4529-9936-60256ef30f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5af29b6-7b74-4529-9936-60256ef30f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2136921954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c779d29f-af23-4b9e-a014-1db6a380747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:36Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18424d38-38eb-42c8-9b83-a6ce526d36b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18424d38-38eb-42c8-9b83-a6ce526d36b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e79411-9684-4ad0-a6f5-000fee54b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e79411-9684-4ad0-a6f5-000fee54b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c779d29f-af23-4b9e-a014-1db6a380747a', 'volume_name': 'volume-c779d29f-af23-4b9e-a014-1db6a380747a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b719b9ae-8937-4cc3-a192-b27669e4411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b719b9ae-8937-4cc3-a192-b27669e4411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c616f-feae-41b2-b50b-8d7ea4427a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Volume c779d29f-af23-4b9e-a014-1db6a380747a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c779d29f-af23-4b9e-a014-1db6a380747a', 'volume_size': 1} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:36 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf" returned: 0 in 0.649s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-600058848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b667681f-ef95-4060-8079-409608163ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:35Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Creating volume b667681f-ef95-4060-8079-409608163ef0 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:31:36 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:36 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 1073741824 Jul 05 05:31:36 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1ca42b-168a-4749-87f7-ed91de95aaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f15ef0d-7b44-4485-9d24-6673aacc9edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Volume volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf (7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf): created successfully Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f15ef0d-7b44-4485-9d24-6673aacc9edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (8336fcd5-ab4b-4f8c-ae9e-5749afb3c973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-cf5a9c5d-2d86-4a32-bf02-e3c351787401 tempest-CreateVolumesFromImageTest-1552106237 None] Created volume successfully. Jul 05 05:31:37 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 1073741824" returned: 0 in 0.829s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:37 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 Jul 05 05:31:37 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:38 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0" returned: 0 in 0.657s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.540s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2046566425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3795a7d-aa59-4466-98ea-c6d4d9f9e001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:35Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Creating volume f3795a7d-aa59-4466-98ea-c6d4d9f9e001 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:31:38 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:38 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 1073741824 Jul 05 05:31:38 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5e1240-efe3-48d1-b99e-6f2c5e3ff039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b667681f-ef95-4060-8079-409608163ef0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5383b49-8ec3-4a20-816b-feb8f84d5653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Volume volume-b667681f-ef95-4060-8079-409608163ef0 (b667681f-ef95-4060-8079-409608163ef0): created successfully Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5383b49-8ec3-4a20-816b-feb8f84d5653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (fde7b697-7444-4e3d-a8d2-1f2ec3650b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9961cd48-4ca3-4f1f-b2dd-20c758930d17 tempest-CreateVolumesFromImageTest-1552106237 None] Created volume successfully. Jul 05 05:31:38 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 1073741824" returned: 0 in 0.837s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:38 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 Jul 05 05:31:38 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:39 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001" returned: 0 in 0.643s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.731s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1976842651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42223d3c-a5f7-4154-aaae-56d975c6d31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:36Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Creating volume 42223d3c-a5f7-4154-aaae-56d975c6d31e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:31:39 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:39 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e 1073741824 Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2228196-b835-4170-a945-8c6ddac9f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:39 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f928f9b6-0a66-40c8-bebb-e2bf674f2d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:39 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Volume volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 (f3795a7d-aa59-4466-98ea-c6d4d9f9e001): created successfully Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f928f9b6-0a66-40c8-bebb-e2bf674f2d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (cfb495dd-d6d1-4fce-8353-366b349060f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ec4d6a5e-d556-42f9-a7cc-5e87ed1cfcf4 tempest-CreateVolumesFromImageTest-1552106237 None] Created volume successfully. Jul 05 05:31:40 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e 1073741824" returned: 0 in 0.804s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:40 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e Jul 05 05:31:40 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:41 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e" returned: 0 in 0.652s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.834s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2136921954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c779d29f-af23-4b9e-a014-1db6a380747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0a562b85f445638c737af2f09e4264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:31:36Z,use_quota=True,user_id='eaae6b8093e546d8a956c6904ece356c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Creating volume c779d29f-af23-4b9e-a014-1db6a380747a {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:31:41 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:41 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a 1073741824 Jul 05 05:31:41 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fae3a9e-dba0-438f-b3c3-5f670fe4e376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42223d3c-a5f7-4154-aaae-56d975c6d31e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7931d4a5-7956-44f1-b850-3336d2c6bf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Volume volume-42223d3c-a5f7-4154-aaae-56d975c6d31e (42223d3c-a5f7-4154-aaae-56d975c6d31e): created successfully Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7931d4a5-7956-44f1-b850-3336d2c6bf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (c32e65b3-23d4-4254-af43-6a13f8832921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-74168eba-ed19-44fe-a4ae-dcf7db3cc5ee tempest-CreateVolumesFromImageTest-1552106237 None] Created volume successfully. Jul 05 05:31:41 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a 1073741824" returned: 0 in 0.793s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:41 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a Jul 05 05:31:41 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:42 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a" returned: 0 in 0.636s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c616f-feae-41b2-b50b-8d7ea4427a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c779d29f-af23-4b9e-a014-1db6a380747a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35cc3e5-ad39-442e-a250-df31ccf33ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:31:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Volume volume-c779d29f-af23-4b9e-a014-1db6a380747a (c779d29f-af23-4b9e-a014-1db6a380747a): created successfully Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35cc3e5-ad39-442e-a250-df31ccf33ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Flow 'volume_create_manager' (26e58aa8-9752-4ea8-a8fd-65a9c92fa0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:31:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-216976a3-88df-4751-9403-43499556a2be tempest-CreateVolumesFromImageTest-1552106237 None] Created volume successfully. Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-c779d29f-af23-4b9e-a014-1db6a380747a-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-c779d29f-af23-4b9e-a014-1db6a380747a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-quobyte-c779d29f-af23-4b9e-a014-1db6a380747a" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-c779d29f-af23-4b9e-a014-1db6a380747a" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[148d7ea7-1170-4045-a71d-168d49c6d57d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:42 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a Jul 05 05:31:42 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:43 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a" returned: 0 in 0.747s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:43 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a Jul 05 05:31:43 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:44 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c779d29f-af23-4b9e-a014-1db6a380747a" returned: 0 in 0.649s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-c779d29f-af23-4b9e-a014-1db6a380747a" released by "delete_volume" :: held 1.434s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Created reservations ['a0b6a1f9-b25f-4c25-874b-c8d125582729', '5390e477-207a-49a3-ae27-f58abc3e448c', 'f78e9dc2-fe1a-4cd4-86fe-1e48b72e2824', 'e21471bd-9896-49c5-b7fb-85f7e120e5f7'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:44 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:44 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-42223d3c-a5f7-4154-aaae-56d975c6d31e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:44 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-42223d3c-a5f7-4154-aaae-56d975c6d31e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.651s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:44 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Deleted volume successfully. Jul 05 05:31:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-085af544-6283-412c-83c9-6d1555487205 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-c779d29f-af23-4b9e-a014-1db6a380747a-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-quobyte-42223d3c-a5f7-4154-aaae-56d975c6d31e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-42223d3c-a5f7-4154-aaae-56d975c6d31e" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be45870-463f-45d5-828f-5d80c4b20c51]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:45 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e Jul 05 05:31:45 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:45 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e" returned: 0 in 0.739s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:45 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e Jul 05 05:31:45 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:46 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-42223d3c-a5f7-4154-aaae-56d975c6d31e" returned: 0 in 0.649s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-42223d3c-a5f7-4154-aaae-56d975c6d31e" released by "delete_volume" :: held 1.424s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Created reservations ['422dfd12-d6df-4597-970d-fb06bc1092ab', '62c1be53-758a-43e4-b38f-a0256e6fd814', '3a514bf2-6ce1-4a0c-9518-d2a77674dfbe', '319c2b5a-5619-4436-965e-78e059aba1fc'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:46 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:46 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-f3795a7d-aa59-4466-98ea-c6d4d9f9e001-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:47 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-f3795a7d-aa59-4466-98ea-c6d4d9f9e001-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Deleted volume successfully. Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6b14a697-ed1d-41f0-99d0-631b2ed9ff41 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-42223d3c-a5f7-4154-aaae-56d975c6d31e-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-quobyte-f3795a7d-aa59-4466-98ea-c6d4d9f9e001" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-f3795a7d-aa59-4466-98ea-c6d4d9f9e001" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9210418a-1feb-4207-9a50-8dc029c5d2a4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:47 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 Jul 05 05:31:47 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:48 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001" returned: 0 in 0.746s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:48 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001 Jul 05 05:31:48 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:48 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3795a7d-aa59-4466-98ea-c6d4d9f9e001" returned: 0 in 0.636s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-f3795a7d-aa59-4466-98ea-c6d4d9f9e001" released by "delete_volume" :: held 1.420s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Created reservations ['0d5099b2-088a-457f-a526-3a8e8b7557bd', 'bee28555-8b6f-4974-b9a5-c14fd1de0a6f', 'fcad2ee3-1912-4ba9-b6bc-399a5cd2e203', 'd05b5aff-316d-4f2e-977e-e1ce4e92f851'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:48 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:48 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-b667681f-ef95-4060-8079-409608163ef0-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:49 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.623s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-b667681f-ef95-4060-8079-409608163ef0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Deleted volume successfully. Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36303bbc-c2ce-42b7-8687-51a3835ba76f tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-f3795a7d-aa59-4466-98ea-c6d4d9f9e001-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-quobyte-b667681f-ef95-4060-8079-409608163ef0" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-b667681f-ef95-4060-8079-409608163ef0" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be9f1b-b416-464e-9a9d-2304603100b0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:49 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 Jul 05 05:31:49 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:50 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0" returned: 0 in 0.737s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:50 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0 Jul 05 05:31:50 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:50 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b667681f-ef95-4060-8079-409608163ef0" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-b667681f-ef95-4060-8079-409608163ef0" released by "delete_volume" :: held 1.411s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Created reservations ['5239361f-dd6e-4ac4-9940-fe23a4fd7287', '96183661-3c49-407c-88b2-c4472d85685a', 'd37ef3a9-67df-4d1b-9963-c4bfc648affd', '611a65b9-1cd4-4275-b3ec-585b6cc43991'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:51 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:51 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:51 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.621s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Deleted volume successfully. Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-48609bbe-9adf-4d77-9325-9c5ed610e6d0 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-b667681f-ef95-4060-8079-409608163ef0-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "cinder-quobyte-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b5ed1b-c46c-4e84-a642-ec58c5e35fec]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:31:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:51 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf Jul 05 05:31:51 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:52 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf" returned: 0 in 0.752s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:52 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf Jul 05 05:31:52 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:53 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-quobyte-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf" released by "delete_volume" :: held 1.430s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Created reservations ['25093280-3ea0-427d-9195-62263bdb779f', '34f969cf-f7a0-4bec-83c9-8798530a0691', 'e9971b28-bbac-4c88-a0cc-f78012f528ab', 'd18582a5-0085-4b39-acc2-e20259e808ea'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:31:53 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:31:53 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:31:53 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.674s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:31:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Deleted volume successfully. Jul 05 05:31:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b7a59c35-de62-42d8-971e-e02d451a81b4 tempest-CreateVolumesFromImageTest-1552106237 None] Lock "cinder-7999f3e0-b2ec-4fef-9b6d-f4813f3d39cf-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:03 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=71,cinder:SELECT=42,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:32:03 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=37,cinder:UPDATE=56,cinder:INSERT=13,cinder:DELETE=6 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (c11c1d04-4839-4f54-90f2-aef388905d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aab838-707e-43bc-9040-9bf8376199ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aab838-707e-43bc-9040-9bf8376199ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677906216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee89d2b-2a10-4541-a80b-a6d3c2175ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:10Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f7393-d34a-4d81-b867-f21ef962b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f7393-d34a-4d81-b867-f21ef962b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2140f5-0a7f-4c7d-805c-bf5c092221a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2140f5-0a7f-4c7d-805c-bf5c092221a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee89d2b-2a10-4541-a80b-a6d3c2175ef3', 'volume_name': 'volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab71a1a-01fb-4a87-8c0a-240f90552b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab71a1a-01fb-4a87-8c0a-240f90552b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef2117f-369c-48b7-8b5b-8b029b9bd086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume 5ee89d2b-2a10-4541-a80b-a6d3c2175ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3', 'volume_size': 1} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677906216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee89d2b-2a10-4541-a80b-a6d3c2175ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:10Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Creating volume 5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:09 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:09 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 1073741824 Jul 05 05:32:09 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (08f382cd-6f7c-42d3-b112-1d28543afca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a136b129-e6bd-4eb6-9eb0-114cb43b718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a136b129-e6bd-4eb6-9eb0-114cb43b718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136969367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b84b86-4402-413a-b943-96c8fe4ccf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:10Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42499e99-ddf4-438a-9096-fb1ac33f1811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42499e99-ddf4-438a-9096-fb1ac33f1811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba90ffde-7947-4072-86fe-41800b3020a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba90ffde-7947-4072-86fe-41800b3020a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b84b86-4402-413a-b943-96c8fe4ccf3e', 'volume_name': 'volume-25b84b86-4402-413a-b943-96c8fe4ccf3e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9983d8ba-e400-4595-81fb-d1b34e112648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9983d8ba-e400-4595-81fb-d1b34e112648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2eb118-e36e-4e24-bbd0-7348febcd422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Volume 25b84b86-4402-413a-b943-96c8fe4ccf3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b84b86-4402-413a-b943-96c8fe4ccf3e', 'volume_size': 1} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (fc7ed33e-8465-4786-a042-9cc77ff18ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca54277-373d-4b8e-bb37-05e81106198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca54277-373d-4b8e-bb37-05e81106198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1427033659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bdf13b-abe9-486e-84e0-c17b74cefafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:11Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b5f82c-daa0-4a0c-8769-b248fce94836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b5f82c-daa0-4a0c-8769-b248fce94836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3f08b0-fb10-482c-83b7-4e7bd95968c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3f08b0-fb10-482c-83b7-4e7bd95968c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6bdf13b-abe9-486e-84e0-c17b74cefafc', 'volume_name': 'volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b8c9c4-01e8-4865-bbc8-9e4220c0d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b8c9c4-01e8-4865-bbc8-9e4220c0d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0cfb51-54a4-41f8-a9d9-bd98dbea1ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:10 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Volume b6bdf13b-abe9-486e-84e0-c17b74cefafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc', 'volume_size': 1} Jul 05 05:32:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (417c8523-2557-474a-a8fe-e1f0c981b93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48889e2f-75bb-4bc8-b019-5a493f95dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48889e2f-75bb-4bc8-b019-5a493f95dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-782990653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3d37c8-5c49-41e6-bb8d-19babdb24be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:11Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a913a2d4-01c9-4d38-993c-0c27aadb113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a913a2d4-01c9-4d38-993c-0c27aadb113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697651bf-13e6-426b-9e97-df9232f4ca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (697651bf-13e6-426b-9e97-df9232f4ca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3d37c8-5c49-41e6-bb8d-19babdb24be7', 'volume_name': 'volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d146a2-76de-4b43-a601-05f97ab5beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d146a2-76de-4b43-a601-05f97ab5beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f725e4d-4cc5-47d1-94d0-9c89ac5c3462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:11 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Volume 8d3d37c8-5c49-41e6-bb8d-19babdb24be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7', 'volume_size': 1} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:11 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 1073741824" returned: 0 in 1.430s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:11 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 Jul 05 05:32:11 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (89b2312f-d5e3-4aa6-90d5-3610fa2c7612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:11 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8b3a95-f5f6-4abe-a89d-17ebd7710e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d8b3a95-f5f6-4abe-a89d-17ebd7710e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981475179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237660fb-9ac2-4cbe-8c9b-8a09afffbdf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:12Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3db90a2-5479-4683-b392-539b62339405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3db90a2-5479-4683-b392-539b62339405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24537067-4572-48a4-805f-ed0d0d6a3b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24537067-4572-48a4-805f-ed0d0d6a3b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237660fb-9ac2-4cbe-8c9b-8a09afffbdf3', 'volume_name': 'volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72752c47-8403-4574-9851-4ac2b4042ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72752c47-8403-4574-9851-4ac2b4042ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aff3be-3a04-4021-9d4d-807834bd6f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Volume 237660fb-9ac2-4cbe-8c9b-8a09afffbdf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3', 'volume_size': 1} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:12 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (a4254b38-88ca-4ed3-b205-89645077c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d38612-9aa2-423e-baf4-567988537254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" returned: 0 in 0.944s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.933s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136969367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b84b86-4402-413a-b943-96c8fe4ccf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:10Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Creating volume 25b84b86-4402-413a-b943-96c8fe4ccf3e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:12 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d38612-9aa2-423e-baf4-567988537254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-536823609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ac1483-cde8-4c7b-acdd-2d73d4874646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:12Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a203d50-956b-489a-83d3-0e98efe6d853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e 1073741824 Jul 05 05:32:12 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a203d50-956b-489a-83d3-0e98efe6d853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d30fee-496f-4391-8214-4ea773f3ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d30fee-496f-4391-8214-4ea773f3ab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ac1483-cde8-4c7b-acdd-2d73d4874646', 'volume_name': 'volume-04ac1483-cde8-4c7b-acdd-2d73d4874646', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c361c63d-0292-424f-9088-2e7bf2f83623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c361c63d-0292-424f-9088-2e7bf2f83623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5282f331-0599-4bf2-b52e-af5c93d2a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Volume 04ac1483-cde8-4c7b-acdd-2d73d4874646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ac1483-cde8-4c7b-acdd-2d73d4874646', 'volume_size': 1} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef2117f-369c-48b7-8b5b-8b029b9bd086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f09558-d103-4436-8933-7b6aeb4d8928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:12 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 (5ee89d2b-2a10-4541-a80b-a6d3c2175ef3): created successfully Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f09558-d103-4436-8933-7b6aeb4d8928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:12 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (c11c1d04-4839-4f54-90f2-aef388905d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:12 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a216ca31-5d45-4842-acbf-73472f2026fb tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created volume successfully. Jul 05 05:32:13 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e 1073741824" returned: 0 in 1.068s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:13 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e Jul 05 05:32:13 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Flow 'volume_create_manager' (ede0def4-00dc-43b1-91c1-b8cb4c03bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fbf7d8-b8f0-4683-956e-fbcba843a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81fbf7d8-b8f0-4683-956e-fbcba843a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a542b3-686d-4512-a7e2-2e832b0bae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95b59a442b4ceabee2a5695e357069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:13Z,use_quota=True,user_id='652c63cf014649ed8276534c0a740565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e051f2f-b193-48bb-8075-ebcc9debce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e051f2f-b193-48bb-8075-ebcc9debce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7986baa6-0cd3-4b80-9bd0-6be11c59b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7986baa6-0cd3-4b80-9bd0-6be11c59b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19a542b3-686d-4512-a7e2-2e832b0bae12', 'volume_name': 'volume-19a542b3-686d-4512-a7e2-2e832b0bae12', 'volume_size': 1, 'image_id': 'f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '308146978a59d65bf5aff31095f60013', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3c95b59a442b4ceabee2a5695e357069', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2b9599a830f5c6eb89fdc613b18e864b2b9020b9ff7a8feecf72f173e9c6f68de0dac1388b81dddc94923f1f9699486eb76751e83356011db7a09bf39c8ef43', 'id': 'f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'created_at': datetime.datetime(2026, 7, 5, 3, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464/file', 'properties': {}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e1b30f-1895-420b-9a2a-9123e4e623b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e1b30f-1895-420b-9a2a-9123e4e623b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538edccc-744e-4a94-a0f5-47f344fdf701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:13 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Volume 19a542b3-686d-4512-a7e2-2e832b0bae12: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19a542b3-686d-4512-a7e2-2e832b0bae12', 'volume_size': 1, 'image_id': 'f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '308146978a59d65bf5aff31095f60013', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3c95b59a442b4ceabee2a5695e357069', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2b9599a830f5c6eb89fdc613b18e864b2b9020b9ff7a8feecf72f173e9c6f68de0dac1388b81dddc94923f1f9699486eb76751e83356011db7a09bf39c8ef43', 'id': 'f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'created_at': datetime.datetime(2026, 7, 5, 3, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464/file', 'properties': {}}, 'image_service': } Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Trying to clone 19a542b3-686d-4512-a7e2-2e832b0bae12 from image f0eb69ab-7f54-4129-a5f6-12d2c3499464 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:32:13 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:32:13 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Image download 0.00 MB at 0.00 MB/s Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ba7c75-5c30-4f75-8652-6bfec3bd4a5b]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:14 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD Jul 05 05:32:14 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:14 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e" returned: 0 in 0.689s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.300s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1427033659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bdf13b-abe9-486e-84e0-c17b74cefafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:11Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Creating volume b6bdf13b-abe9-486e-84e0-c17b74cefafc {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:14 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2eb118-e36e-4e24-bbd0-7348febcd422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b84b86-4402-413a-b943-96c8fe4ccf3e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64008fb2-6eb4-433c-911c-f9ab8824ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:14 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc 1073741824 Jul 05 05:32:14 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:14 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Volume volume-25b84b86-4402-413a-b943-96c8fe4ccf3e (25b84b86-4402-413a-b943-96c8fe4ccf3e): created successfully Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64008fb2-6eb4-433c-911c-f9ab8824ea07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (08f382cd-6f7c-42d3-b112-1d28543afca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-60d09f55-7885-4c67-9952-0b1cc23bb73b tempest-CreateVolumesFromImageTest-1371591838 None] Created volume successfully. Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Flow 'volume_create_manager' (a5ea3893-f5dd-4013-87a2-5d3f5ba9a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6136b7b2-9cf7-444c-913b-32eb34e303bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6136b7b2-9cf7-444c-913b-32eb34e303bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b2f086-7e41-422a-b8f1-790d43f5134a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f82fb65847423bb2914ce2416f50d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:14Z,use_quota=True,user_id='b2e5e24deb454b26a79b0f1d1e18c488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(312be9f5-ee2f-4f14-bdae-d47ee44af197),volume_type_id=312be9f5-ee2f-4f14-bdae-d47ee44af197)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadafa94-876b-4ee1-9b68-8986086b14f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadafa94-876b-4ee1-9b68-8986086b14f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42cf4c8-df15-4a75-95c6-ed67a72fcf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.image.glance [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Creating Keystone auth plugin from conf {{(pid=86688) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42cf4c8-df15-4a75-95c6-ed67a72fcf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26b2f086-7e41-422a-b8f1-790d43f5134a', 'volume_name': 'volume-26b2f086-7e41-422a-b8f1-790d43f5134a', 'volume_size': 1, 'image_id': '92239dc7-f28e-410a-b5bb-37a675b8e940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92239dc7-f28e-410a-b5bb-37a675b8e940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbd30cc6d08f89e5dd0f10af304c72a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6f82fb65847423bb2914ce2416f50d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '127c384bf08bc8a26eb8e248de483c594331b406ff0712039caf211b4ed3b26fb8a96be3920ee822b230cae9a574e15a65f845afe18e5503fbbc94a1bf59ff76', 'id': '92239dc7-f28e-410a-b5bb-37a675b8e940', 'created_at': datetime.datetime(2026, 7, 5, 3, 32, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 32, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92239dc7-f28e-410a-b5bb-37a675b8e940/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e70e80-c32c-440a-bebc-b3919c5892f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e70e80-c32c-440a-bebc-b3919c5892f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c1dd44-6f53-4955-8c54-60fbf1c70d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:14 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Volume 26b2f086-7e41-422a-b8f1-790d43f5134a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26b2f086-7e41-422a-b8f1-790d43f5134a', 'volume_size': 1, 'image_id': '92239dc7-f28e-410a-b5bb-37a675b8e940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92239dc7-f28e-410a-b5bb-37a675b8e940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbd30cc6d08f89e5dd0f10af304c72a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6f82fb65847423bb2914ce2416f50d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '127c384bf08bc8a26eb8e248de483c594331b406ff0712039caf211b4ed3b26fb8a96be3920ee822b230cae9a574e15a65f845afe18e5503fbbc94a1bf59ff76', 'id': '92239dc7-f28e-410a-b5bb-37a675b8e940', 'created_at': datetime.datetime(2026, 7, 5, 3, 32, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 32, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92239dc7-f28e-410a-b5bb-37a675b8e940/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Trying to clone 26b2f086-7e41-422a-b8f1-790d43f5134a from image 92239dc7-f28e-410a-b5bb-37a675b8e940 at location (None, [{'url': 'file:///opt/stack/data/glance/images/92239dc7-f28e-410a-b5bb-37a675b8e940', 'metadata': {}}]). {{(pid=86688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 05:32:14 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:14 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 05:32:14 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Image download 0.00 MB at 0.00 MB/s Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[3750cf9d-d847-483f-835b-4510a1d90bb9]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:15 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD Jul 05 05:32:15 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:15 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD Jul 05 05:32:15 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:15 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc 1073741824" returned: 0 in 1.009s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:15 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc Jul 05 05:32:15 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:15 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Temporary image f0eb69ab-7f54-4129-a5f6-12d2c3499464 is fetched for user 652c63cf014649ed8276534c0a740565. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd356b7c-d5ac-4d4e-a6a3-bcae4689341a]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:15 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:15 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD Jul 05 05:32:15 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:15 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc" returned: 0 in 0.680s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.618s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-782990653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3d37c8-5c49-41e6-bb8d-19babdb24be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:11Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Creating volume 8d3d37c8-5c49-41e6-bb8d-19babdb24be7 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:15 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:15 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD Jul 05 05:32:15 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:15 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 1073741824 Jul 05 05:32:15 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0cfb51-54a4-41f8-a9d9-bd98dbea1ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46869cd5-f7e0-4505-aed1-a44a3f0bfed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:15 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Volume volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc (b6bdf13b-abe9-486e-84e0-c17b74cefafc): created successfully Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46869cd5-f7e0-4505-aed1-a44a3f0bfed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (fc7ed33e-8465-4786-a042-9cc77ff18ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c8c1cb1c-5e75-401d-bc87-f91d1d6bc17a tempest-CreateVolumesFromImageTest-1371591838 None] Created volume successfully. Jul 05 05:32:16 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:16 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD" returned: 1 in 0.764s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Temporary image 92239dc7-f28e-410a-b5bb-37a675b8e940 is fetched for user b2e5e24deb454b26a79b0f1d1e18c488. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 05:32:16 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD Jul 05 05:32:16 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5488fd31-7d6f-454d-b029-c770af2cade1]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:16 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD Jul 05 05:32:16 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:16 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 1073741824" returned: 0 in 0.927s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:16 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 Jul 05 05:32:16 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:17 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD" returned: 1 in 0.782s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:17 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD" returned: 0 in 0.777s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:17 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7" returned: 0 in 0.656s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.445s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981475179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237660fb-9ac2-4cbe-8c9b-8a09afffbdf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:12Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Creating volume 237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:17 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:17 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD Jul 05 05:32:17 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:17 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 1073741824 Jul 05 05:32:17 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f725e4d-4cc5-47d1-94d0-9c89ac5c3462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbe5ad-8e3f-4486-938d-0837a4a1a283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:17 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Volume volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 (8d3d37c8-5c49-41e6-bb8d-19babdb24be7): created successfully Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fbe5ad-8e3f-4486-938d-0837a4a1a283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (417c8523-2557-474a-a8fe-e1f0c981b93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4c1463ad-1b72-4f27-b969-b3aa3c86c290 tempest-CreateVolumesFromImageTest-1371591838 None] Created volume successfully. Jul 05 05:32:18 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD" returned: 1 in 0.765s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:18 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 1073741824" returned: 0 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:18 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 Jul 05 05:32:18 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:19 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.623s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-536823609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ac1483-cde8-4c7b-acdd-2d73d4874646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f287781e0e0e4003bd705ce5cdf45389',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:12Z,use_quota=True,user_id='223d4a3a3e4443caa6d4cd084ffc1f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Creating volume 04ac1483-cde8-4c7b-acdd-2d73d4874646 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:19 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:19 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 1073741824 Jul 05 05:32:19 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51aff3be-3a04-4021-9d4d-807834bd6f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eee091e-0b81-4b31-9208-61761905fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Volume volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 (237660fb-9ac2-4cbe-8c9b-8a09afffbdf3): created successfully Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eee091e-0b81-4b31-9208-61761905fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (89b2312f-d5e3-4aa6-90d5-3610fa2c7612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-31ca7a3d-7c59-44e3-8ec7-ca2295fca782 tempest-CreateVolumesFromImageTest-1371591838 None] Created volume successfully. Jul 05 05:32:19 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 1073741824" returned: 0 in 0.811s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:19 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 Jul 05 05:32:19 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:20 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646" returned: 0 in 0.687s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.070s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5282f331-0599-4bf2-b52e-af5c93d2a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ac1483-cde8-4c7b-acdd-2d73d4874646', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ad9f88-0443-4373-afea-fc6f1c620d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Creating offline snapshot 129ad899-2d55-4162-a808-728e83bc245c of volume 5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c561cc-424c-4513-bf13-c524eaae8997]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Volume volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 (04ac1483-cde8-4c7b-acdd-2d73d4874646): created successfully Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ad9f88-0443-4373-afea-fc6f1c620d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Flow 'volume_create_manager' (a4254b38-88ca-4ed3-b205-89645077c830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:20 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-708c6b39-7e52-4f10-802f-c26d1ffb23d0 tempest-CreateVolumesFromImageTest-1371591838 None] Created volume successfully. Jul 05 05:32:20 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 Jul 05 05:32:20 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-04ac1483-cde8-4c7b-acdd-2d73d4874646-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-04ac1483-cde8-4c7b-acdd-2d73d4874646-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-quobyte-04ac1483-cde8-4c7b-acdd-2d73d4874646" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-04ac1483-cde8-4c7b-acdd-2d73d4874646" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[262001ff-25c0-41db-8456-e88e0c668d15]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:21 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 Jul 05 05:32:21 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:21 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" returned: 0 in 0.784s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:21 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c 1G Jul 05 05:32:21 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:22 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646" returned: 0 in 0.790s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:22 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646 Jul 05 05:32:22 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:22 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c 1G" returned: 0 in 0.812s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:22 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c Jul 05 05:32:22 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:22 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-04ac1483-cde8-4c7b-acdd-2d73d4874646" returned: 0 in 0.643s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-04ac1483-cde8-4c7b-acdd-2d73d4874646" released by "delete_volume" :: held 1.475s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Created reservations ['c4c8513e-fe92-4752-8fa4-faf6e17f50bd', 'e9735d10-902e-4275-8b16-5982156d9aa4', '9f768226-08ee-46cb-8341-b22d297296ae', '23092042-6393-486f-be44-5921cd113273'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:22 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:22 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:22 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c" returned: 0 in 0.770s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:22 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c is being set with open permissions: ugo+rw Jul 05 05:32:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:23 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c Jul 05 05:32:23 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-quobyte-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8da81-44e3-478b-8894-247899786603]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:23 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Deleted volume successfully. Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-66e8c9e0-0014-4ecc-8cfc-5b43810463ce tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-04ac1483-cde8-4c7b-acdd-2d73d4874646-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:23 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 Jul 05 05:32:23 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:23 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c" returned: 0 in 0.720s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:23 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.info Jul 05 05:32:23 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:24 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3" returned: 0 in 0.789s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:24 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3 Jul 05 05:32:24 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:24 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.info" returned: 0 in 0.679s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:24 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.info is being set with open permissions: ugo+rw Jul 05 05:32:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:24 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.info Jul 05 05:32:24 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:24 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3" returned: 0 in 0.657s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:24 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3" released by "delete_volume" :: held 1.500s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Created reservations ['28a1e9f4-c4c8-4f13-a4f9-3bee0903eec6', 'c9655975-cd63-41e7-923f-001f6fcc9374', '7b12452c-1960-4995-9918-5cc66f9b4e3e', 'a234c3c0-8dbf-49cd-92f6-160d10d274ca'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:25 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:25 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.info" returned: 0 in 0.691s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:25 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.561s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.834s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a542b3-686d-4512-a7e2-2e832b0bae12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c95b59a442b4ceabee2a5695e357069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:13Z,use_quota=True,user_id='652c63cf014649ed8276534c0a740565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Creating volume 19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:25 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:25 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 1073741824 Jul 05 05:32:25 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:25 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5e678090-b18b-417e-98c5-63a2d64f85e8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Create snapshot completed successfully Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-8d3d37c8-5c49-41e6-bb8d-19babdb24be7-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-8d3d37c8-5c49-41e6-bb8d-19babdb24be7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-quobyte-8d3d37c8-5c49-41e6-bb8d-19babdb24be7" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-8d3d37c8-5c49-41e6-bb8d-19babdb24be7" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1abe6e-fd02-45a6-907a-085380f33a63]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:25 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.706s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:25 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Deleted volume successfully. Jul 05 05:32:25 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9ed11d18-9297-4590-bcf4-ab172e4cfb2f tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-237660fb-9ac2-4cbe-8c9b-8a09afffbdf3-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:25 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 Jul 05 05:32:25 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:26 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 1073741824" returned: 0 in 0.931s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:26 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 Jul 05 05:32:26 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (50b3f9c7-5d68-4af6-a691-c6566c6ee970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5814972-e8c0-443b-8a4c-11a162c6bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5814972-e8c0-443b-8a4c-11a162c6bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822018006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9ac40b-a0dc-4461-a583-23fa620c65ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:26Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5edc6d-7081-485f-9b82-ea67805908aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5edc6d-7081-485f-9b82-ea67805908aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f7c470-2c53-45fd-89c1-3df1a841a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f7c470-2c53-45fd-89c1-3df1a841a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9ac40b-a0dc-4461-a583-23fa620c65ee', 'volume_name': 'volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d069cfb0-2fc5-4fbb-91d1-790f5a8ab505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d069cfb0-2fc5-4fbb-91d1-790f5a8ab505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23eadf9-f440-4db0-9c08-3cbbc6126a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume 4a9ac40b-a0dc-4461-a583-23fa620c65ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee', 'volume_size': 1} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:26 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7" returned: 0 in 1.026s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:26 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7 Jul 05 05:32:26 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (168582e6-9392-407f-a0d8-773386eadcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2a1ab1-a3b5-425c-a3cb-bf8a3fa50be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2a1ab1-a3b5-425c-a3cb-bf8a3fa50be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1402577246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219652d6-c55d-46dc-bf7f-394b1c2fd65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:27Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f8d628-c4be-41ce-af06-0734a0cbfedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f8d628-c4be-41ce-af06-0734a0cbfedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658d4c26-c200-4135-b623-65457610fa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658d4c26-c200-4135-b623-65457610fa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219652d6-c55d-46dc-bf7f-394b1c2fd65a', 'volume_name': 'volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ca43b3-6739-47dd-b986-beb82a243bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ca43b3-6739-47dd-b986-beb82a243bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9507097-3958-4442-8c83-9d47376f72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:26 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume 219652d6-c55d-46dc-bf7f-394b1c2fd65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a', 'volume_size': 1} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:26 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12" returned: 0 in 0.813s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.715s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b2f086-7e41-422a-b8f1-790d43f5134a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f82fb65847423bb2914ce2416f50d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:14Z,use_quota=True,user_id='b2e5e24deb454b26a79b0f1d1e18c488',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(312be9f5-ee2f-4f14-bdae-d47ee44af197),volume_type_id=312be9f5-ee2f-4f14-bdae-d47ee44af197)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Creating volume 26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:26 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:26 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a 1073741824 Jul 05 05:32:26 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:26 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Attempting download of f0eb69ab-7f54-4129-a5f6-12d2c3499464 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'metadata': {}}])) to volume 19a542b3-686d-4512-a7e2-2e832b0bae12. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c9afd-6090-43f1-808f-381dff06f30d]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0eb69ab-7f54-4129-a5f6-12d2c3499464_kxvjfm0v {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:27 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0eb69ab-7f54-4129-a5f6-12d2c3499464_kxvjfm0v Jul 05 05:32:27 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (c49708a6-3b4d-4b07-8f26-6f293ab2a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf1cdaf-1b03-48a1-87cf-f210eb1bb955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faf1cdaf-1b03-48a1-87cf-f210eb1bb955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-272950062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc214b83-0364-479a-bbaf-9562af9d1aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:27Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf3aa7-2f82-4410-a83b-863107cb8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf3aa7-2f82-4410-a83b-863107cb8953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fccc0b2-da8e-48c9-b959-df0837c8c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fccc0b2-da8e-48c9-b959-df0837c8c819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc214b83-0364-479a-bbaf-9562af9d1aaa', 'volume_name': 'volume-dc214b83-0364-479a-bbaf-9562af9d1aaa', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d30352-46c4-4209-956a-03fedddbe8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d30352-46c4-4209-956a-03fedddbe8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17419b1b-954d-455f-8856-8366caeea2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume dc214b83-0364-479a-bbaf-9562af9d1aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc214b83-0364-479a-bbaf-9562af9d1aaa', 'volume_size': 1} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:27 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8d3d37c8-5c49-41e6-bb8d-19babdb24be7" returned: 0 in 0.850s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-8d3d37c8-5c49-41e6-bb8d-19babdb24be7" released by "delete_volume" :: held 1.930s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Created reservations ['0d08657b-fb44-4125-8884-6d7c3a0fa42a', '3f05ed1b-ce3f-49db-a28f-b2822e560a35', '32b09db6-8cdf-412e-8283-514e5c7d91fd', '0a7caec6-f556-4c2b-a160-120ede476dc9'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (2b78c795-fec3-43fa-aaa4-53febb44384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9a3387-eefb-4096-9294-2e63bf773c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9a3387-eefb-4096-9294-2e63bf773c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361782722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6feb510-81ac-4640-b92d-4804c28fa515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:28Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fd39c3-7a50-4898-a6b0-d78588e44bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fd39c3-7a50-4898-a6b0-d78588e44bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb68872-d630-49eb-94b9-fe9d108c1e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb68872-d630-49eb-94b9-fe9d108c1e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6feb510-81ac-4640-b92d-4804c28fa515', 'volume_name': 'volume-c6feb510-81ac-4640-b92d-4804c28fa515', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afee0abb-83c5-4399-94ab-f7655211f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afee0abb-83c5-4399-94ab-f7655211f24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8fe4bd-bcab-4457-9157-e86f06f1bc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:27 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume c6feb510-81ac-4640-b92d-4804c28fa515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6feb510-81ac-4640-b92d-4804c28fa515', 'volume_size': 1} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:27 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:27 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:27 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-b6bdf13b-abe9-486e-84e0-c17b74cefafc-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-b6bdf13b-abe9-486e-84e0-c17b74cefafc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-quobyte-b6bdf13b-abe9-486e-84e0-c17b74cefafc" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-b6bdf13b-abe9-486e-84e0-c17b74cefafc" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e4526d-fd53-442a-bcef-d8a4c1476035]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:28 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0eb69ab-7f54-4129-a5f6-12d2c3499464_kxvjfm0v" returned: 0 in 1.142s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0eb69ab-7f54-4129-a5f6-12d2c3499464_kxvjfm0v {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:28 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:28 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc Jul 05 05:32:28 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a 1073741824" returned: 0 in 1.422s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (df21fbb2-7be9-42a9-b630-674c44f6909b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ff0e96-a228-4bcc-8ac9-64d7baee8c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:28 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0eb69ab-7f54-4129-a5f6-12d2c3499464_kxvjfm0v Jul 05 05:32:28 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ff0e96-a228-4bcc-8ac9-64d7baee8c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459939521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db37401b-4825-42e6-b178-c238e571e90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:28Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a5324c-4188-4ddc-86b6-d4865d3208d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3a5324c-4188-4ddc-86b6-d4865d3208d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826ad136-18ee-4fc2-9142-2dbe8a105c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826ad136-18ee-4fc2-9142-2dbe8a105c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db37401b-4825-42e6-b178-c238e571e90e', 'volume_name': 'volume-db37401b-4825-42e6-b178-c238e571e90e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36964440-16a6-4ecb-88f4-ebe66eeef24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36964440-16a6-4ecb-88f4-ebe66eeef24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054f2811-40a6-45e3-8827-b5b62244575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:28 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume db37401b-4825-42e6-b178-c238e571e90e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db37401b-4825-42e6-b178-c238e571e90e', 'volume_size': 1} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:28 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a Jul 05 05:32:28 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:28 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.825s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:28 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Deleted volume successfully. Jul 05 05:32:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-69712f55-7df0-416e-aba7-692a0d95b003 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-8d3d37c8-5c49-41e6-bb8d-19babdb24be7-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:29 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc" returned: 0 in 0.937s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:29 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0eb69ab-7f54-4129-a5f6-12d2c3499464_kxvjfm0v" returned: 1 in 0.892s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0eb69ab-7f54-4129-a5f6-12d2c3499464_kxvjfm0v' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f8085f-a820-4e37-a8a9-afa2cfaca236]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:29 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc Jul 05 05:32:29 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:29 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD Jul 05 05:32:29 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:29 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a" returned: 0 in 0.686s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.834s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-822018006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9ac40b-a0dc-4461-a583-23fa620c65ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:26Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Creating volume 4a9ac40b-a0dc-4461-a583-23fa620c65ee {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:29 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:29 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee 1073741824 Jul 05 05:32:29 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Attempting download of 92239dc7-f28e-410a-b5bb-37a675b8e940 ((None, [{'url': 'file:///opt/stack/data/glance/images/92239dc7-f28e-410a-b5bb-37a675b8e940', 'metadata': {}}])) to volume 26b2f086-7e41-422a-b8f1-790d43f5134a. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faf1a1e-49f5-4114-9082-601e196938a0]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92239dc7-f28e-410a-b5bb-37a675b8e940_zoh8gvz9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:29 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92239dc7-f28e-410a-b5bb-37a675b8e940_zoh8gvz9 Jul 05 05:32:29 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:29 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b6bdf13b-abe9-486e-84e0-c17b74cefafc" returned: 0 in 0.737s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-b6bdf13b-abe9-486e-84e0-c17b74cefafc" released by "delete_volume" :: held 1.736s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Created reservations ['82170923-7775-4bf4-8243-4488bc1fe195', 'cbc61ffa-e4d0-4735-94d7-667055427f6d', '2091ba96-a2ab-413b-bd17-e1ec4e53c823', '3bbc2f64-743d-4961-9265-32b074a6203c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:29 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:30 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:30 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:30 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD Jul 05 05:32:30 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:30 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee 1073741824" returned: 0 in 0.909s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:30 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92239dc7-f28e-410a-b5bb-37a675b8e940_zoh8gvz9" returned: 0 in 0.833s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92239dc7-f28e-410a-b5bb-37a675b8e940_zoh8gvz9 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-25b84b86-4402-413a-b943-96c8fe4ccf3e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:30 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee Jul 05 05:32:30 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-25b84b86-4402-413a-b943-96c8fe4ccf3e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "cinder-quobyte-25b84b86-4402-413a-b943-96c8fe4ccf3e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-25b84b86-4402-413a-b943-96c8fe4ccf3e" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:30 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92239dc7-f28e-410a-b5bb-37a675b8e940_zoh8gvz9 Jul 05 05:32:30 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68806d4-301e-46f6-9d4e-a47c8379eb2b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:30 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:30 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:30 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e Jul 05 05:32:30 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:30 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.929s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:30 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:30 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Deleted volume successfully. Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dd372cd7-113a-4a22-b46b-b03556af0042 tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-b6bdf13b-abe9-486e-84e0-c17b74cefafc-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:31 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD" returned: 1 in 1.083s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] f0eb69ab-7f54-4129-a5f6-12d2c3499464 was raw, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:31 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 Jul 05 05:32:31 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:31 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92239dc7-f28e-410a-b5bb-37a675b8e940_zoh8gvz9" returned: 1 in 1.029s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92239dc7-f28e-410a-b5bb-37a675b8e940_zoh8gvz9' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9093a7-186a-4ae8-b4ab-83f23cd45c9f]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:31 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee" returned: 0 in 1.032s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.428s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1402577246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219652d6-c55d-46dc-bf7f-394b1c2fd65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:27Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Creating volume 219652d6-c55d-46dc-bf7f-394b1c2fd65a {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:31 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23eadf9-f440-4db0-9c08-3cbbc6126a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:31 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a 1073741824 Jul 05 05:32:31 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23fe4a8-38fe-4196-a082-a0146cd16da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:31 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD Jul 05 05:32:31 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:31 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee (4a9ac40b-a0dc-4461-a583-23fa620c65ee): created successfully Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23fe4a8-38fe-4196-a082-a0146cd16da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (50b3f9c7-5d68-4af6-a691-c6566c6ee970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:31 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0e8e4df6-f9e7-4744-afa3-f48e3892e1d0 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created volume successfully. Jul 05 05:32:31 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.001s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:32:31 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e" returned: 0 in 1.388s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:31 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e Jul 05 05:32:31 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:32 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12" returned: 0 in 0.979s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0eb69ab-7f54-4129-a5f6-12d2c3499464_lhxyi2wwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:32:32 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:32 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 1G Jul 05 05:32:32 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:32 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD" returned: 0 in 0.996s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:32 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD Jul 05 05:32:32 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:32 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a 1073741824" returned: 0 in 1.073s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:32 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a Jul 05 05:32:32 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:32 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-25b84b86-4402-413a-b943-96c8fe4ccf3e" returned: 0 in 0.734s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-quobyte-25b84b86-4402-413a-b943-96c8fe4ccf3e" released by "delete_volume" :: held 2.198s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Created reservations ['cb5c0f30-8cbc-496e-8854-600ed1d18405', '92f6c83b-8910-44ef-81a2-4d70523434e1', '4575f8a1-9333-4a4c-987c-d877ff4c16f3', 'e52b950a-cabd-40ba-a4fa-5bcfc3518b7d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:32 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 1G" returned: 0 in 0.849s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:32 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:32 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6d263-1bd6-420f-a011-6b9d3d45499e]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:33 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 Jul 05 05:32:33 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:33 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD" returned: 1 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] 92239dc7-f28e-410a-b5bb-37a675b8e940 was raw, converting to raw {{(pid=86688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:33 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a Jul 05 05:32:33 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:33 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a" returned: 0 in 0.810s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.831s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-272950062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc214b83-0364-479a-bbaf-9562af9d1aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:27Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Creating volume dc214b83-0364-479a-bbaf-9562af9d1aaa {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:33 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:33 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa 1073741824 Jul 05 05:32:33 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9507097-3958-4442-8c83-9d47376f72f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddaa952-f767-47c5-aca8-18e565ef371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:33 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a (219652d6-c55d-46dc-bf7f-394b1c2fd65a): created successfully Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ddaa952-f767-47c5-aca8-18e565ef371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (168582e6-9392-407f-a0d8-773386eadcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5f37d6cb-a2b9-44fe-857a-b430383b1ada tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created volume successfully. Jul 05 05:32:33 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.752s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Deleted volume successfully. Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fafc9c72-eba9-472d-a546-ba7a23c962ed tempest-CreateVolumesFromImageTest-1371591838 None] Lock "cinder-25b84b86-4402-413a-b943-96c8fe4ccf3e-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:33 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12" returned: 0 in 0.901s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:33 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 Jul 05 05:32:33 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:34 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a" returned: 0 in 0.944s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92239dc7-f28e-410a-b5bb-37a675b8e940_45lkq3g9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:32:34 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:34 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a 1G Jul 05 05:32:34 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:34 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa 1073741824" returned: 0 in 1.118s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:34 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa Jul 05 05:32:34 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:34 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12" returned: 1 in 0.931s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Downloaded image f0eb69ab-7f54-4129-a5f6-12d2c3499464 ((None, [{'url': 'file:///opt/stack/data/glance/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'metadata': {}}])) to volume 19a542b3-686d-4512-a7e2-2e832b0bae12 successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Temporary image f0eb69ab-7f54-4129-a5f6-12d2c3499464 for user 652c63cf014649ed8276534c0a740565 is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Marking volume 19a542b3-686d-4512-a7e2-2e832b0bae12 as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Copying metadata from image f0eb69ab-7f54-4129-a5f6-12d2c3499464 to 19a542b3-686d-4512-a7e2-2e832b0bae12. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Creating volume glance metadata for volume 19a542b3-686d-4512-a7e2-2e832b0bae12 backed by image f0eb69ab-7f54-4129-a5f6-12d2c3499464 with: {'image_id': 'f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '308146978a59d65bf5aff31095f60013', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538edccc-744e-4a94-a0f5-47f344fdf701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a542b3-686d-4512-a7e2-2e832b0bae12', 'volume_size': 1, 'image_id': 'f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '308146978a59d65bf5aff31095f60013', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3c95b59a442b4ceabee2a5695e357069', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2b9599a830f5c6eb89fdc613b18e864b2b9020b9ff7a8feecf72f173e9c6f68de0dac1388b81dddc94923f1f9699486eb76751e83356011db7a09bf39c8ef43', 'id': 'f0eb69ab-7f54-4129-a5f6-12d2c3499464', 'created_at': datetime.datetime(2026, 7, 5, 3, 32, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 32, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0eb69ab-7f54-4129-a5f6-12d2c3499464/file', 'properties': {}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef09a10b-70af-4cfb-895b-5d9ed6aafc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:34 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Volume volume-19a542b3-686d-4512-a7e2-2e832b0bae12 (19a542b3-686d-4512-a7e2-2e832b0bae12): created successfully Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef09a10b-70af-4cfb-895b-5d9ed6aafc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Flow 'volume_create_manager' (ede0def4-00dc-43b1-91c1-b8cb4c03bae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:34 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7952ca32-fb29-442b-a329-950e7beb2de3 tempest-VolumeImageDependencyTests-1354276994 None] Created volume successfully. Jul 05 05:32:34 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a 1G" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a825732-d4dc-46b0-a960-af83b6e57199]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:35 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a Jul 05 05:32:35 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Acquiring lock "cinder-19a542b3-686d-4512-a7e2-2e832b0bae12-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Lock "cinder-19a542b3-686d-4512-a7e2-2e832b0bae12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:35 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa" returned: 0 in 0.936s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.544s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361782722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6feb510-81ac-4640-b92d-4804c28fa515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:28Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Creating volume c6feb510-81ac-4640-b92d-4804c28fa515 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:35 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:35 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 1073741824 Jul 05 05:32:35 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17419b1b-954d-455f-8856-8366caeea2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc214b83-0364-479a-bbaf-9562af9d1aaa', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e88787-3e9f-4ce1-b691-b66e3d5575e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Acquiring lock "cinder-quobyte-19a542b3-686d-4512-a7e2-2e832b0bae12" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume volume-dc214b83-0364-479a-bbaf-9562af9d1aaa (dc214b83-0364-479a-bbaf-9562af9d1aaa): created successfully Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e88787-3e9f-4ce1-b691-b66e3d5575e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (c49708a6-3b4d-4b07-8f26-6f293ab2a36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Lock "cinder-quobyte-19a542b3-686d-4512-a7e2-2e832b0bae12" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-296309bb-3c67-4d1d-9fa3-02fd5e8bbfc8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created volume successfully. Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[731613e5-9fcd-4e3c-a340-2d8313dbbb90]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:35 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 Jul 05 05:32:35 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:35 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:36 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a Jul 05 05:32:36 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:36 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12" returned: 0 in 0.911s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:36 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 1073741824" returned: 0 in 1.085s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:36 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 Jul 05 05:32:36 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:36 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 Jul 05 05:32:36 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:36 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a" returned: 1 in 0.880s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Downloaded image 92239dc7-f28e-410a-b5bb-37a675b8e940 ((None, [{'url': 'file:///opt/stack/data/glance/images/92239dc7-f28e-410a-b5bb-37a675b8e940', 'metadata': {}}])) to volume 26b2f086-7e41-422a-b8f1-790d43f5134a successfully. {{(pid=86688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Temporary image 92239dc7-f28e-410a-b5bb-37a675b8e940 for user b2e5e24deb454b26a79b0f1d1e18c488 is deleted. {{(pid=86688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.volume_utils [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Marking volume 26b2f086-7e41-422a-b8f1-790d43f5134a as bootable. {{(pid=86688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Copying metadata from image 92239dc7-f28e-410a-b5bb-37a675b8e940 to 26b2f086-7e41-422a-b8f1-790d43f5134a. {{(pid=86688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Creating volume glance metadata for volume 26b2f086-7e41-422a-b8f1-790d43f5134a backed by image 92239dc7-f28e-410a-b5bb-37a675b8e940 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '92239dc7-f28e-410a-b5bb-37a675b8e940', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cbd30cc6d08f89e5dd0f10af304c72a1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c1dd44-6f53-4955-8c54-60fbf1c70d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b2f086-7e41-422a-b8f1-790d43f5134a', 'volume_size': 1, 'image_id': '92239dc7-f28e-410a-b5bb-37a675b8e940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92239dc7-f28e-410a-b5bb-37a675b8e940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbd30cc6d08f89e5dd0f10af304c72a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6f82fb65847423bb2914ce2416f50d5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '127c384bf08bc8a26eb8e248de483c594331b406ff0712039caf211b4ed3b26fb8a96be3920ee822b230cae9a574e15a65f845afe18e5503fbbc94a1bf59ff76', 'id': '92239dc7-f28e-410a-b5bb-37a675b8e940', 'created_at': datetime.datetime(2026, 7, 5, 3, 32, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 3, 32, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92239dc7-f28e-410a-b5bb-37a675b8e940/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce644ce2-450d-49b9-908e-640852086897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Volume volume-26b2f086-7e41-422a-b8f1-790d43f5134a (26b2f086-7e41-422a-b8f1-790d43f5134a): created successfully Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce644ce2-450d-49b9-908e-640852086897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Flow 'volume_create_manager' (a5ea3893-f5dd-4013-87a2-5d3f5ba9a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:36 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4ee30a19-2407-4589-ae46-1d9c9a2d79cb tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Created volume successfully. Jul 05 05:32:37 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Acquiring lock "cinder-26b2f086-7e41-422a-b8f1-790d43f5134a-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515" returned: 0 in 0.800s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.774s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1459939521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db37401b-4825-42e6-b178-c238e571e90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a026748b1c7b4266a72a76e990dde31e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:28Z,use_quota=True,user_id='618959c8a39d40dca00d1641bfc3b6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Creating volume db37401b-4825-42e6-b178-c238e571e90e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:37 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:37 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:37 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e 1073741824 Jul 05 05:32:37 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (57ad599a-543b-4210-9063-a06b03f3d914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60b2b05-acde-4758-b880-94727649f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "cinder-26b2f086-7e41-422a-b8f1-790d43f5134a-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12" returned: 1 in 0.945s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8fe4bd-bcab-4457-9157-e86f06f1bc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6feb510-81ac-4640-b92d-4804c28fa515', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb930e9-7da0-42af-a052-800884bba8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:37 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12 Jul 05 05:32:37 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60b2b05-acde-4758-b880-94727649f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1695597480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b72977-f568-428f-bd23-636181988e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:37Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf310f8-3f04-4076-b090-8468b908fff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf310f8-3f04-4076-b090-8468b908fff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad67306-c984-4b3b-8ff9-92aeb0a86bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad67306-c984-4b3b-8ff9-92aeb0a86bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b72977-f568-428f-bd23-636181988e2f', 'volume_name': 'volume-d8b72977-f568-428f-bd23-636181988e2f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc98a57-c916-4de1-b67e-9082da2854d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc98a57-c916-4de1-b67e-9082da2854d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07c5cd2-3a71-44e3-a3b4-cea5a79b44e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume d8b72977-f568-428f-bd23-636181988e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b72977-f568-428f-bd23-636181988e2f', 'volume_size': 1} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume volume-c6feb510-81ac-4640-b92d-4804c28fa515 (c6feb510-81ac-4640-b92d-4804c28fa515): created successfully Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb930e9-7da0-42af-a052-800884bba8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (2b78c795-fec3-43fa-aaa4-53febb44384b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f33e31d1-d5fb-4143-9d57-6322146e67d8 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created volume successfully. Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Acquiring lock "cinder-quobyte-26b2f086-7e41-422a-b8f1-790d43f5134a" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "cinder-quobyte-26b2f086-7e41-422a-b8f1-790d43f5134a" acquired by "delete_volume" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[df735d18-4409-427a-8410-c95c0cc56aed]: (4, 'raw') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:37 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a Jul 05 05:32:37 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:38 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-19a542b3-686d-4512-a7e2-2e832b0bae12" returned: 0 in 0.722s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Lock "cinder-quobyte-19a542b3-686d-4512-a7e2-2e832b0bae12" released by "delete_volume" :: held 2.671s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:38 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e 1073741824" returned: 0 in 0.853s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Created reservations ['7eef2ab9-ad96-4b1a-b135-5cdf488b0d55', '20d81329-1390-4d3b-9bfc-7a5030b3480e', '7c146cee-5987-41fb-963f-266879ff348e', '3b0a630d-1455-4f2f-9566-f028105c9d4b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:38 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e Jul 05 05:32:38 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:38 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:38 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:38 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a" returned: 0 in 0.768s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:38 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a Jul 05 05:32:38 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:39 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e" returned: 0 in 0.780s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1695597480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b72977-f568-428f-bd23-636181988e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:37Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Creating volume d8b72977-f568-428f-bd23-636181988e2f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:39 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:39 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f 1073741824 Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054f2811-40a6-45e3-8827-b5b62244575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db37401b-4825-42e6-b178-c238e571e90e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:39 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810729e3-2a2f-4bc3-9a83-5f8278abfda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:39 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.853s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:39 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Volume volume-db37401b-4825-42e6-b178-c238e571e90e (db37401b-4825-42e6-b178-c238e571e90e): created successfully Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810729e3-2a2f-4bc3-9a83-5f8278abfda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Flow 'volume_create_manager' (df21fbb2-7be9-42a9-b630-674c44f6909b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Deleted volume successfully. Jul 05 05:32:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-16d36927-ba8f-4e76-a040-8b5073b08447 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created volume successfully. Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-863a750f-acea-4af3-aa07-d0885cdc040d tempest-VolumeImageDependencyTests-1354276994 None] Lock "cinder-19a542b3-686d-4512-a7e2-2e832b0bae12-delete_volume" released by "delete_volume" :: held 3.936s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:39 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a" returned: 1 in 1.161s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a' failed. Not Retrying. {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:39 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a Jul 05 05:32:39 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-db37401b-4825-42e6-b178-c238e571e90e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-db37401b-4825-42e6-b178-c238e571e90e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-db37401b-4825-42e6-b178-c238e571e90e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-db37401b-4825-42e6-b178-c238e571e90e" acquired by "delete_volume" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487a56d-3b1c-4681-aa44-0040c2e339fe]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:40 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e Jul 05 05:32:40 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:40 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f 1073741824" returned: 0 in 1.167s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:40 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f Jul 05 05:32:40 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:40 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-26b2f086-7e41-422a-b8f1-790d43f5134a" returned: 0 in 0.934s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "cinder-quobyte-26b2f086-7e41-422a-b8f1-790d43f5134a" released by "delete_volume" :: held 2.946s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Created reservations ['7018a0f5-dd25-4278-b435-9dc7657f7ce1', '570f4122-06ae-43a6-9ac7-7269c841b282', '3747cc17-b59c-44fd-8705-10357d09fdd9', '29d15955-bb58-4977-b0b6-da0cd73fc664'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:40 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:40 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:41 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e" returned: 0 in 1.223s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:41 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e Jul 05 05:32:41 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:41 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f" returned: 0 in 0.916s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07c5cd2-3a71-44e3-a3b4-cea5a79b44e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b72977-f568-428f-bd23-636181988e2f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ac5554-8ca4-491c-bd1c-63d82e48f104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume volume-d8b72977-f568-428f-bd23-636181988e2f (d8b72977-f568-428f-bd23-636181988e2f): created successfully Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ac5554-8ca4-491c-bd1c-63d82e48f104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (57ad599a-543b-4210-9063-a06b03f3d914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f3dfc706-520d-4333-ad52-eedbd602d8b3 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created volume successfully. Jul 05 05:32:41 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.764s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Deleted volume successfully. Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e6685889-5ec5-4649-9bdf-a6a7c585b978 tempest-VolumeAndVolumeTypeFromImageTest-307369694 None] Lock "cinder-26b2f086-7e41-422a-b8f1-790d43f5134a-delete_volume" released by "delete_volume" :: held 4.167s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:41 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-db37401b-4825-42e6-b178-c238e571e90e" returned: 0 in 0.807s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-db37401b-4825-42e6-b178-c238e571e90e" released by "delete_volume" :: held 2.085s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created reservations ['14d94a40-2e6b-4156-876f-0b548784c3d3', '7cffc57a-56f3-4ef1-8933-a25a4e4d4a8d', '7a3430df-80a0-4cdd-aa2d-a1ab7f5b04b6', 'a504c12a-d5e5-47d0-9179-df118d5e22c0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:42 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:42 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (af95b698-602c-4fe5-8364-b67f570492af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa51b19-b819-4506-8f9a-afcadd937780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa51b19-b819-4506-8f9a-afcadd937780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908624212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1befd90-3782-439e-a761-05c5b3ad0f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:42Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be8dcf1-5913-4563-ad2d-b6285f92bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be8dcf1-5913-4563-ad2d-b6285f92bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28694a9-61ab-4a4f-9a1e-677046e6ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28694a9-61ab-4a4f-9a1e-677046e6ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1befd90-3782-439e-a761-05c5b3ad0f14', 'volume_name': 'volume-f1befd90-3782-439e-a761-05c5b3ad0f14', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d63df3-2367-40db-b5a6-527f3ed8dab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d63df3-2367-40db-b5a6-527f3ed8dab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44dd73e-556d-4e7c-8df9-39c8078ee91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume f1befd90-3782-439e-a761-05c5b3ad0f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1befd90-3782-439e-a761-05c5b3ad0f14', 'volume_size': 1} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908624212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1befd90-3782-439e-a761-05c5b3ad0f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:42Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Creating volume f1befd90-3782-439e-a761-05c5b3ad0f14 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:42 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:42 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 1073741824 Jul 05 05:32:42 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (c00c9793-d7c5-4869-bccc-2e8d0c043081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8119838e-49fd-4eef-8e24-e75e1ae77636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8119838e-49fd-4eef-8e24-e75e1ae77636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247644132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30e4649-edf3-431a-8104-43ce3ae4a32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:43Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd0eac3-7f1e-45f7-9523-dc40d6b12ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd0eac3-7f1e-45f7-9523-dc40d6b12ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5a1958-564e-456d-94da-1f9d7a9fa3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5a1958-564e-456d-94da-1f9d7a9fa3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30e4649-edf3-431a-8104-43ce3ae4a32d', 'volume_name': 'volume-e30e4649-edf3-431a-8104-43ce3ae4a32d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e729bd6d-79bf-44e6-9891-4b6933f83049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e729bd6d-79bf-44e6-9891-4b6933f83049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acb3499-cadc-4fed-95b2-e4f77a0c8028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume e30e4649-edf3-431a-8104-43ce3ae4a32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30e4649-edf3-431a-8104-43ce3ae4a32d', 'volume_size': 1} Jul 05 05:32:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-c6feb510-81ac-4640-b92d-4804c28fa515-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-c6feb510-81ac-4640-b92d-4804c28fa515-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:43 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.329s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (dc8464a2-dc32-4d1f-9caf-c1061fff78ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cc1bdf-56e2-4607-9ece-1ce894a4de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:43 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Deleted volume successfully. Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cc1bdf-56e2-4607-9ece-1ce894a4de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371730054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09a3673-2ac9-49f8-aa4a-c83320acfbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:43Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bbf6bb-1be4-447f-b079-821ae9d6a668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bbf6bb-1be4-447f-b079-821ae9d6a668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b60aaa2-545c-4a01-b8a4-ab2439a4022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b60aaa2-545c-4a01-b8a4-ab2439a4022a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09a3673-2ac9-49f8-aa4a-c83320acfbb8', 'volume_name': 'volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33015bf0-cc4a-47a9-92df-9ec976852502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33015bf0-cc4a-47a9-92df-9ec976852502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0584907-6447-460e-8802-44777ad9daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:43 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume e09a3673-2ac9-49f8-aa4a-c83320acfbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8', 'volume_size': 1} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-c6feb510-81ac-4640-b92d-4804c28fa515" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-58ee2747-251f-4954-88b3-3167b834e83e tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-db37401b-4825-42e6-b178-c238e571e90e-delete_volume" released by "delete_volume" :: held 3.873s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-c6feb510-81ac-4640-b92d-4804c28fa515" acquired by "delete_volume" :: waited 0.041s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd0c0b-8331-4f81-9106-3fa7bf233bb6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:43 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 1073741824" returned: 0 in 1.383s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:44 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 Jul 05 05:32:44 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:44 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 Jul 05 05:32:44 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (3050277f-aae8-4038-a4e3-21edd7a93744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed04c4c5-809b-4784-9ba8-8e75028f7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed04c4c5-809b-4784-9ba8-8e75028f7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235490235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b249a2e3-36e0-4101-ae2f-a3f92a6e720c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:44Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b50b01-07e1-4985-9812-1c56e807fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b50b01-07e1-4985-9812-1c56e807fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dbf16f-4f53-4eea-86aa-fcb434fc1c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16dbf16f-4f53-4eea-86aa-fcb434fc1c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b249a2e3-36e0-4101-ae2f-a3f92a6e720c', 'volume_name': 'volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3019463-3e30-4a9f-a2d7-b2dd8935a3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3019463-3e30-4a9f-a2d7-b2dd8935a3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03f4ad8-766d-4ca2-beb2-7204abc00695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume b249a2e3-36e0-4101-ae2f-a3f92a6e720c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c', 'volume_size': 1} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (c9f30aa9-59ac-4b3b-b936-e7336fa6fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec99329-b7b9-48bc-8f8b-a725f53a4b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec99329-b7b9-48bc-8f8b-a725f53a4b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055972810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9d88a8-64e3-44fc-a8be-07bd9e629e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:45Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788e9752-f41d-4768-a7c9-4edd17eac391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788e9752-f41d-4768-a7c9-4edd17eac391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d01109-355d-4150-a973-a2e422eddd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d01109-355d-4150-a973-a2e422eddd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9d88a8-64e3-44fc-a8be-07bd9e629e40', 'volume_name': 'volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897094c0-c390-401c-a071-6034b51b2c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897094c0-c390-401c-a071-6034b51b2c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ae796c-4c05-4ba8-8e7b-75c1d60d33e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:44 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume ed9d88a8-64e3-44fc-a8be-07bd9e629e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40', 'volume_size': 1} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14" returned: 0 in 1.013s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] <== create_volume: return (2506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.147s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247644132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30e4649-edf3-431a-8104-43ce3ae4a32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:43Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Creating volume e30e4649-edf3-431a-8104-43ce3ae4a32d {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:45 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a44dd73e-556d-4e7c-8df9-39c8078ee91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1befd90-3782-439e-a761-05c5b3ad0f14', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad499c0-eed6-4dc4-964c-a354e0ed9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:45 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d 1073741824 Jul 05 05:32:45 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:45 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume volume-f1befd90-3782-439e-a761-05c5b3ad0f14 (f1befd90-3782-439e-a761-05c5b3ad0f14): created successfully Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad499c0-eed6-4dc4-964c-a354e0ed9eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (af95b698-602c-4fe5-8364-b67f570492af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:45 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:45 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-916c589f-2375-4614-885a-912cd557dcb9 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created volume successfully. Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515" returned: 0 in 1.321s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:45 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515 Jul 05 05:32:45 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:45 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c6feb510-81ac-4640-b92d-4804c28fa515" returned: 0 in 0.779s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-c6feb510-81ac-4640-b92d-4804c28fa515" released by "delete_volume" :: held 2.177s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:45 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created reservations ['52fed7f1-c84e-4620-93c6-0abd6bbb1ea3', '33f86ef8-34ed-4ef1-9ecc-01221ffcb425', 'c5232b06-a6fe-450c-8130-473edab9e076', 'f4478ef8-9948-4fc5-a69b-7a8aa0104a1f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:46 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:46 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d 1073741824" returned: 0 in 1.289s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:46 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:46 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d Jul 05 05:32:46 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:46 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:46 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Deleted volume successfully. Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0d64db18-cf4a-41a4-a17c-b0fc4635fe84 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-c6feb510-81ac-4640-b92d-4804c28fa515-delete_volume" released by "delete_volume" :: held 3.510s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-dc214b83-0364-479a-bbaf-9562af9d1aaa-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-dc214b83-0364-479a-bbaf-9562af9d1aaa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-dc214b83-0364-479a-bbaf-9562af9d1aaa" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-dc214b83-0364-479a-bbaf-9562af9d1aaa" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:47 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d" returned: 0 in 0.906s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a720f50-3599-43b1-8948-8b0283bdf863]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.582s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1371730054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09a3673-2ac9-49f8-aa4a-c83320acfbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:43Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Creating volume e09a3673-2ac9-49f8-aa4a-c83320acfbb8 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:47 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:47 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 1073741824 Jul 05 05:32:47 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acb3499-cadc-4fed-95b2-e4f77a0c8028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30e4649-edf3-431a-8104-43ce3ae4a32d', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e11f51-40d1-48e8-997a-b23d2bfbf734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:47 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume volume-e30e4649-edf3-431a-8104-43ce3ae4a32d (e30e4649-edf3-431a-8104-43ce3ae4a32d): created successfully Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e11f51-40d1-48e8-997a-b23d2bfbf734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (c00c9793-d7c5-4869-bccc-2e8d0c043081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d74f86b2-fad1-4b6b-abf1-06f718fc812f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created volume successfully. Jul 05 05:32:47 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa Jul 05 05:32:47 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:48 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa" returned: 0 in 0.990s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:48 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa Jul 05 05:32:48 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:48 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 1073741824" returned: 0 in 1.158s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:48 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 Jul 05 05:32:48 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:48 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dc214b83-0364-479a-bbaf-9562af9d1aaa" returned: 0 in 0.731s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-dc214b83-0364-479a-bbaf-9562af9d1aaa" released by "delete_volume" :: held 1.799s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created reservations ['2dd8a880-927a-4ca2-873d-2f6ee66dc94a', 'c5caac35-ba3a-4b22-bb0f-7e4ba00cdc3e', 'f167bef6-77f8-4245-90a0-98733c211071', '5a183134-3035-4036-a651-7ee1db63010f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:49 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:49 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:49 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8" returned: 0 in 0.914s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.238s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235490235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b249a2e3-36e0-4101-ae2f-a3f92a6e720c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:44Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Creating volume b249a2e3-36e0-4101-ae2f-a3f92a6e720c {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:49 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0584907-6447-460e-8802-44777ad9daf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:49 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c 1073741824 Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83966c71-29af-4044-84fd-fe14c822ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:49 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-219652d6-c55d-46dc-bf7f-394b1c2fd65a-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:49 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 (e09a3673-2ac9-49f8-aa4a-c83320acfbb8): created successfully Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83966c71-29af-4044-84fd-fe14c822ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (dc8464a2-dc32-4d1f-9caf-c1061fff78ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-219652d6-c55d-46dc-bf7f-394b1c2fd65a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a800012b-afd7-4482-a821-b535355fdf8d tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created volume successfully. Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-219652d6-c55d-46dc-bf7f-394b1c2fd65a" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-219652d6-c55d-46dc-bf7f-394b1c2fd65a" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f086a5a-cdb0-412a-bb92-16720cf4e6b3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:49 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a Jul 05 05:32:49 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:50 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.902s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:50 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Deleted volume successfully. Jul 05 05:32:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f1bc2095-126e-4a78-a590-d7dfd5c2ebb6 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-dc214b83-0364-479a-bbaf-9562af9d1aaa-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:50 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:50 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c 1073741824" returned: 0 in 1.177s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a" returned: 0 in 0.900s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:50 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a Jul 05 05:32:50 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:50 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c Jul 05 05:32:50 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:51 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-219652d6-c55d-46dc-bf7f-394b1c2fd65a" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-219652d6-c55d-46dc-bf7f-394b1c2fd65a" released by "delete_volume" :: held 1.751s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:51 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c" returned: 0 in 0.781s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.455s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055972810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9d88a8-64e3-44fc-a8be-07bd9e629e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e94bc5b2054b389f0ed9340610da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:45Z,use_quota=True,user_id='d0f1a562e5954985976d43cd09975a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Creating volume ed9d88a8-64e3-44fc-a8be-07bd9e629e40 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:51 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:51 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 1073741824 Jul 05 05:32:51 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03f4ad8-766d-4ca2-beb2-7204abc00695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47618dd-bfe5-40ea-9599-ce1f0efebd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:51 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c (b249a2e3-36e0-4101-ae2f-a3f92a6e720c): created successfully Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47618dd-bfe5-40ea-9599-ce1f0efebd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (3050277f-aae8-4038-a4e3-21edd7a93744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6d799ccb-7308-4cce-a6f4-00eb99e49cfe tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created volume successfully. Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created reservations ['ae640b43-01c3-4f98-a22d-4b3ef404f501', 'a83730d2-750e-47b1-b618-746141195197', 'a21888dc-0172-4c60-b198-314883d42c33', 'e4808426-68bc-4211-8faf-2dc7b4e04f31'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:51 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:51 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-4a9ac40b-a0dc-4461-a583-23fa620c65ee-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-4a9ac40b-a0dc-4461-a583-23fa620c65ee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-4a9ac40b-a0dc-4461-a583-23fa620c65ee" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-4a9ac40b-a0dc-4461-a583-23fa620c65ee" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d750fc52-57f8-4855-91d6-574ec6726896]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:52 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee Jul 05 05:32:52 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:52 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.748s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Deleted volume successfully. Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a45423fb-037c-4303-b807-3e7a032988ec tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-219652d6-c55d-46dc-bf7f-394b1c2fd65a-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:52 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 1073741824" returned: 0 in 1.290s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:52 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 Jul 05 05:32:52 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:53 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee" returned: 0 in 1.121s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:53 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee Jul 05 05:32:53 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:53 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40" returned: 0 in 0.770s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ae796c-4c05-4ba8-8e7b-75c1d60d33e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d80e5fe-d94c-48e6-b54a-82eed4af84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:53 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Volume volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 (ed9d88a8-64e3-44fc-a8be-07bd9e629e40): created successfully Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d80e5fe-d94c-48e6-b54a-82eed4af84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Flow 'volume_create_manager' (c9f30aa9-59ac-4b3b-b936-e7336fa6fc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6aca307b-d285-4722-a274-edff2ca8da50 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created volume successfully. Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-ed9d88a8-64e3-44fc-a8be-07bd9e629e40-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-ed9d88a8-64e3-44fc-a8be-07bd9e629e40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-quobyte-ed9d88a8-64e3-44fc-a8be-07bd9e629e40" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:53 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-ed9d88a8-64e3-44fc-a8be-07bd9e629e40" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b274d286-cb99-4455-9424-5df1335ea897]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:54 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-4a9ac40b-a0dc-4461-a583-23fa620c65ee" returned: 0 in 1.009s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-4a9ac40b-a0dc-4461-a583-23fa620c65ee" released by "delete_volume" :: held 2.197s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:54 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 Jul 05 05:32:54 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created reservations ['9b563e59-cd6d-45f1-92bd-a84c45478160', '67fc7e5e-61da-49d9-8781-a6bbdf758cbb', '2bb872b1-882b-4dc9-95b3-f62b0baef379', '16ce1606-061e-4587-8706-57c038b8ec19'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:54 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:54 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:55 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40" returned: 0 in 0.976s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:55 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40 Jul 05 05:32:55 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:55 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.806s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:55 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Deleted volume successfully. Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-005d9579-b047-4eb4-96fd-70e35744f0e3 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-4a9ac40b-a0dc-4461-a583-23fa620c65ee-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-129ad899-2d55-4162-a808-728e83bc245c-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-129ad899-2d55-4162-a808-728e83bc245c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-129ad899-2d55-4162-a808-728e83bc245c" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-129ad899-2d55-4162-a808-728e83bc245c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Deleting offline snapshot 129ad899-2d55-4162-a808-728e83bc245c of volume 5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] snapshot_file for this snap is: volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[473b264f-42df-4372-8e83-7570464b07e4]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:55 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c Jul 05 05:32:55 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:55 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ed9d88a8-64e3-44fc-a8be-07bd9e629e40" returned: 0 in 0.787s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-ed9d88a8-64e3-44fc-a8be-07bd9e629e40" released by "delete_volume" :: held 1.835s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created reservations ['35f17d60-d975-4391-9b74-1f5a056394a3', 'ae2f05fc-f4e1-46b4-9417-e70bae937e63', '88cb86ea-2363-4f95-933c-049fb6700c14', '28686eb1-8adb-407f-be6b-f37ad5ef43bc'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:56 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:56 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:56 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c" returned: 0 in 0.954s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0febfc87-0ddd-4cf4-bb1f-6bb8fe262867]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-b249a2e3-36e0-4101-ae2f-a3f92a6e720c-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-b249a2e3-36e0-4101-ae2f-a3f92a6e720c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-quobyte-b249a2e3-36e0-4101-ae2f-a3f92a6e720c" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-b249a2e3-36e0-4101-ae2f-a3f92a6e720c" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:56 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 Jul 05 05:32:56 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa45742c-4e1a-4c80-9240-c6a2e76e131c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Flow 'volume_create_manager' (ab9dc215-f913-477c-bdb3-efe21e0ef2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b74f08-1cdc-4007-be3a-bb06d764bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:56 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c Jul 05 05:32:56 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:56 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b74f08-1cdc-4007-be3a-bb06d764bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586942449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90f5b09-2fd1-4dd6-90a8-a73088c540b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb57857534d54035af514bb9a14ad6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:57Z,use_quota=True,user_id='4e1940c74e8348dabd898c620c18a9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e354337-9f0a-4cfa-aece-3297f78111fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e354337-9f0a-4cfa-aece-3297f78111fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34de582e-ca88-4ce6-86d9-14b2baf85796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34de582e-ca88-4ce6-86d9-14b2baf85796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90f5b09-2fd1-4dd6-90a8-a73088c540b5', 'volume_name': 'volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b64dfa-e201-4868-81ef-bc61bf6c03ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b64dfa-e201-4868-81ef-bc61bf6c03ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c8d74e-42ae-4b01-8873-5b9003cb77de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:56 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Volume b90f5b09-2fd1-4dd6-90a8-a73088c540b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5', 'volume_size': 1} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586942449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90f5b09-2fd1-4dd6-90a8-a73088c540b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb57857534d54035af514bb9a14ad6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:32:57Z,use_quota=True,user_id='4e1940c74e8348dabd898c620c18a9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Creating volume b90f5b09-2fd1-4dd6-90a8-a73088c540b5 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:32:56 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.956s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:56 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Deleted volume successfully. Jul 05 05:32:56 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 1073741824 Jul 05 05:32:56 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-6d0faa5d-87ed-49b6-b59f-e53206754ee7 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-ed9d88a8-64e3-44fc-a8be-07bd9e629e40-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:57 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" returned: 0 in 1.046s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:57 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c Jul 05 05:32:57 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:57 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c" returned: 0 in 1.054s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:57 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c Jul 05 05:32:57 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:58 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 1073741824" returned: 0 in 1.101s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:58 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 Jul 05 05:32:58 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:58 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c" returned: 0 in 0.889s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:58 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c Jul 05 05:32:58 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:58 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b249a2e3-36e0-4101-ae2f-a3f92a6e720c" returned: 0 in 0.759s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-b249a2e3-36e0-4101-ae2f-a3f92a6e720c" released by "delete_volume" :: held 1.896s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created reservations ['2f4b013e-9c86-411f-bd1b-1752913fd925', '1937f2e8-9fae-4601-a034-8937917edcc1', '2022be8d-a1f0-4010-821a-926c12d70064', 'f224aadb-4351-4c65-a88c-11af8ef1252e'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:58 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:32:58 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:58 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5" returned: 0 in 0.779s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-e09a3673-2ac9-49f8-aa4a-c83320acfbb8-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c8d74e-42ae-4b01-8873-5b9003cb77de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0bc625-b061-49ce-9e1f-c7e2176cc3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:32:58 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Volume volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 (b90f5b09-2fd1-4dd6-90a8-a73088c540b5): created successfully Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0bc625-b061-49ce-9e1f-c7e2176cc3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Flow 'volume_create_manager' (ab9dc215-f913-477c-bdb3-efe21e0ef2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:32:58 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-e09a3673-2ac9-49f8-aa4a-c83320acfbb8-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6bbe6b17-82f1-4370-8246-b9bbc66e0fdd tempest-ProjectReaderTests-1550906713 None] Created volume successfully. Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-quobyte-e09a3673-2ac9-49f8-aa4a-c83320acfbb8" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-e09a3673-2ac9-49f8-aa4a-c83320acfbb8" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f5500-c091-4c96-a12c-567d4bd6a3c7]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:32:59 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 Jul 05 05:32:59 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:32:59 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3.129ad899-2d55-4162-a808-728e83bc245c" returned: 0 in 0.971s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-129ad899-2d55-4162-a808-728e83bc245c" released by "_delete_snapshot" :: held 3.995s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" released by "delete_snapshot" :: held 4.028s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created reservations ['f489c3a4-2527-4199-8e60-7a8b3472a75c', '0225f837-2304-49a2-92d9-1e09452c6270', '3d798c15-17e7-49c3-8956-75ad3007e171', 'a77e60bb-6cc3-4b15-86e0-4f4c47f19a84'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:32:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Delete snapshot completed successfully. Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-fb9d1f4e-0feb-4dbe-8caa-09dcb5bf838c tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-129ad899-2d55-4162-a808-728e83bc245c-delete_snapshot" released by "delete_snapshot" :: held 4.229s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:59 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.935s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:32:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Deleted volume successfully. Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-53191fd1-3b7b-4dd7-8d9c-7604981e7f7f tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-b249a2e3-36e0-4101-ae2f-a3f92a6e720c-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "cinder-quobyte-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4632cc54-4ade-4330-9616-ec10ca647a43]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:32:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:00 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 Jul 05 05:33:00 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:00 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8" returned: 0 in 1.044s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:00 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8 Jul 05 05:33:00 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Acquiring lock "cinder-b90f5b09-2fd1-4dd6-90a8-a73088c540b5-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Lock "cinder-b90f5b09-2fd1-4dd6-90a8-a73088c540b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Acquiring lock "cinder-quobyte-b90f5b09-2fd1-4dd6-90a8-a73088c540b5" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Lock "cinder-quobyte-b90f5b09-2fd1-4dd6-90a8-a73088c540b5" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab064f39-23ce-49a7-87ed-aebd93f09e4e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:00 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 Jul 05 05:33:00 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:00 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" returned: 0 in 0.928s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:00 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e09a3673-2ac9-49f8-aa4a-c83320acfbb8" returned: 0 in 0.794s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:00 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3 Jul 05 05:33:00 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-e09a3673-2ac9-49f8-aa4a-c83320acfbb8" released by "delete_volume" :: held 1.908s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created reservations ['20dd7700-7fcb-4937-9a5e-e7db62c7aaee', '95ab8c0f-cfb2-4a5d-9a12-271f22b36605', '4764344a-b045-412a-897d-badd1572b135', '2a9a333d-0673-4c74-bffd-3ecad1f2859c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:01 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:01 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-e30e4649-edf3-431a-8104-43ce3ae4a32d-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-e30e4649-edf3-431a-8104-43ce3ae4a32d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-quobyte-e30e4649-edf3-431a-8104-43ce3ae4a32d" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-e30e4649-edf3-431a-8104-43ce3ae4a32d" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e08fb-d5b7-49c8-95fa-0667d75a6950]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:01 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:01 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5" returned: 0 in 1.126s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:01 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:01 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5 Jul 05 05:33:01 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" returned: 0 in 0.883s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:01 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-quobyte-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3" released by "delete_volume" :: held 1.927s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:01 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Created reservations ['61502ea3-bd25-4760-a70a-aeb415d4f673', 'df3b2847-87fc-4ac4-8c79-90266e80b5e8', '07093a31-f9a4-4a2a-977d-983ee532a57a', 'd1304ff3-a0e5-40e4-8d2c-d317f501809f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:02 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:02 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:02 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.991s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Deleted volume successfully. Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9f4cd1c1-4e8e-44fb-a030-a3668a6c43a2 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-e09a3673-2ac9-49f8-aa4a-c83320acfbb8-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:02 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b90f5b09-2fd1-4dd6-90a8-a73088c540b5" returned: 0 in 0.969s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Lock "cinder-quobyte-b90f5b09-2fd1-4dd6-90a8-a73088c540b5" released by "delete_volume" :: held 2.168s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Created reservations ['bbb7add2-22be-4bde-8eae-bdc38bdf865c', '48c30a30-7680-4e95-a7fb-8044027c5d05', '8d50138b-47a6-4602-8d29-3c3fa43268a8', '8376a6fc-987f-4dfd-9262-41df822c8040'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:02 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d" returned: 0 in 1.405s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:02 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d Jul 05 05:33:02 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:02 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:02 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:03 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.128s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Deleted volume successfully. Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-2d093dec-d345-4748-8823-758dafe6ea68 tempest-CreateVolumesFromSnapshotTest-1371150477 None] Lock "cinder-5ee89d2b-2a10-4541-a80b-a6d3c2175ef3-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:03 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:03 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.055s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Deleted volume successfully. Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e30e4649-edf3-431a-8104-43ce3ae4a32d" returned: 0 in 1.167s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=145,cinder:UPDATE=195,cinder:INSERT=55,cinder:DELETE=23 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-e30e4649-edf3-431a-8104-43ce3ae4a32d" released by "delete_volume" :: held 2.631s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:03 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=150,cinder:UPDATE=219,cinder:DELETE=15,cinder:INSERT=57 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e08c73c8-8b4a-4617-ba52-488cfce979be tempest-ProjectReaderTests-1550906713 None] Lock "cinder-b90f5b09-2fd1-4dd6-90a8-a73088c540b5-delete_volume" released by "delete_volume" :: held 3.611s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created reservations ['f1f6a430-641a-4f31-b097-3f5954b46384', '3e7f228d-f043-4ac8-a6e8-aa1ce6d5dcd5', 'd74f8d55-7ece-41c1-9a0f-fc725d6b3b4e', 'da73498f-74c5-4193-927a-bbfc41d9e8a0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:04 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:04 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Flow 'volume_create_manager' (c947f94d-9dc3-46c5-ac07-1d7adb82258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fe0f66-9171-42d7-b858-fb926b78a80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fe0f66-9171-42d7-b858-fb926b78a80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-693357107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f2fd86-440d-4e3d-bf34-6134e54eec27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb57857534d54035af514bb9a14ad6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:04Z,use_quota=True,user_id='4e1940c74e8348dabd898c620c18a9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b902dba1-08eb-4c3e-ad91-e85732494e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b902dba1-08eb-4c3e-ad91-e85732494e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be99e4e-76f6-4711-9a2a-c5419c65221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be99e4e-76f6-4711-9a2a-c5419c65221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f2fd86-440d-4e3d-bf34-6134e54eec27', 'volume_name': 'volume-28f2fd86-440d-4e3d-bf34-6134e54eec27', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4517209-7707-4842-b476-b941102c0f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4517209-7707-4842-b476-b941102c0f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e60798-c294-4302-a4cd-9fd1aceea34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:04 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Volume 28f2fd86-440d-4e3d-bf34-6134e54eec27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f2fd86-440d-4e3d-bf34-6134e54eec27', 'volume_size': 1} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-693357107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f2fd86-440d-4e3d-bf34-6134e54eec27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb57857534d54035af514bb9a14ad6b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:04Z,use_quota=True,user_id='4e1940c74e8348dabd898c620c18a9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Creating volume 28f2fd86-440d-4e3d-bf34-6134e54eec27 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:04 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:04 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 1073741824 Jul 05 05:33:04 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-f1befd90-3782-439e-a761-05c5b3ad0f14-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-f1befd90-3782-439e-a761-05c5b3ad0f14-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-quobyte-f1befd90-3782-439e-a761-05c5b3ad0f14" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-f1befd90-3782-439e-a761-05c5b3ad0f14" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9d9ae5-23f0-43d8-8cd6-b48098672a9a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:05 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.910s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:05 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Deleted volume successfully. Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0c44a090-9975-418c-8314-3ec47a2bb520 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-e30e4649-edf3-431a-8104-43ce3ae4a32d-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:05 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 Jul 05 05:33:05 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:05 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 1073741824" returned: 0 in 1.262s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:05 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 Jul 05 05:33:05 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:05 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14" returned: 0 in 0.978s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:06 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14 Jul 05 05:33:06 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Flow 'volume_create_manager' (0806137e-9ba3-4eaf-9823-ec3bcb73a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af349a0-18b9-4534-bd3c-e29788b21803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af349a0-18b9-4534-bd3c-e29788b21803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-19065082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371e735b-3763-4b7c-a715-e78a684b16cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed00ef1a42a044818cbb9d7365107253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:06Z,use_quota=True,user_id='1fdf79c29fff4045b6502304d4da5fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9992a21d-1608-4916-bd26-7a77e385d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9992a21d-1608-4916-bd26-7a77e385d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587605cb-1298-46ef-aa09-883e78a16a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587605cb-1298-46ef-aa09-883e78a16a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371e735b-3763-4b7c-a715-e78a684b16cd', 'volume_name': 'volume-371e735b-3763-4b7c-a715-e78a684b16cd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2691bef-6ba6-433c-981c-eaaf44a9aae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2691bef-6ba6-433c-981c-eaaf44a9aae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b94af69-4b19-4eac-bf1f-0f4cd988d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Volume 371e735b-3763-4b7c-a715-e78a684b16cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371e735b-3763-4b7c-a715-e78a684b16cd', 'volume_size': 1} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:06 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f1befd90-3782-439e-a761-05c5b3ad0f14" returned: 0 in 0.806s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-f1befd90-3782-439e-a761-05c5b3ad0f14" released by "delete_volume" :: held 1.833s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created reservations ['1e680832-8ec3-4418-952d-b5c58d0f2cd2', 'f0d5375a-c5b9-46ab-9c64-6701a38344c3', 'f15c6d4c-9aa7-4ad9-88d1-a5aeb04e849c', '16e9ff83-9822-4653-866d-52bcd50d9363'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:06 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27" returned: 0 in 0.993s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.290s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-19065082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371e735b-3763-4b7c-a715-e78a684b16cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed00ef1a42a044818cbb9d7365107253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:06Z,use_quota=True,user_id='1fdf79c29fff4045b6502304d4da5fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Creating volume 371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:06 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:06 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd 1073741824 Jul 05 05:33:06 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e60798-c294-4302-a4cd-9fd1aceea34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f2fd86-440d-4e3d-bf34-6134e54eec27', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cae4ab7-91eb-411a-8e28-39efad5e9a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:07 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Volume volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 (28f2fd86-440d-4e3d-bf34-6134e54eec27): created successfully Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cae4ab7-91eb-411a-8e28-39efad5e9a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Flow 'volume_create_manager' (c947f94d-9dc3-46c5-ac07-1d7adb82258b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:07 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:07 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-96b5818e-30d5-42ca-b2c9-8f2def434025 tempest-ProjectReaderTests-1550906713 None] Created volume successfully. Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-d8b72977-f568-428f-bd23-636181988e2f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-d8b72977-f568-428f-bd23-636181988e2f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "cinder-quobyte-d8b72977-f568-428f-bd23-636181988e2f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-d8b72977-f568-428f-bd23-636181988e2f" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[04413d91-42bc-4e01-b70a-b7febd425362]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:07 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f Jul 05 05:33:07 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Acquiring lock "cinder-28f2fd86-440d-4e3d-bf34-6134e54eec27-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Lock "cinder-28f2fd86-440d-4e3d-bf34-6134e54eec27-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Acquiring lock "cinder-quobyte-28f2fd86-440d-4e3d-bf34-6134e54eec27" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Lock "cinder-quobyte-28f2fd86-440d-4e3d-bf34-6134e54eec27" acquired by "delete_volume" :: waited 0.044s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:08 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.234s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe1c14e-873c-436e-97d9-ec101c21ba7b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:08 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Deleted volume successfully. Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-285f00ae-1c2d-45ac-b195-479d63767aa1 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-f1befd90-3782-439e-a761-05c5b3ad0f14-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:08 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd 1073741824" returned: 0 in 1.454s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:08 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 Jul 05 05:33:08 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:08 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd Jul 05 05:33:08 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:08 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f" returned: 0 in 1.210s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:08 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f Jul 05 05:33:08 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:09 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27" returned: 0 in 1.000s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:09 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27 Jul 05 05:33:09 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:09 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:09 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd" returned: 0 in 0.847s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] <== create_volume: return (2367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.370s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-d8b72977-f568-428f-bd23-636181988e2f" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-quobyte-d8b72977-f568-428f-bd23-636181988e2f" released by "delete_volume" :: held 2.066s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b94af69-4b19-4eac-bf1f-0f4cd988d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371e735b-3763-4b7c-a715-e78a684b16cd', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392db77b-71db-47c1-a733-b7ebd7611402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:09 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Volume volume-371e735b-3763-4b7c-a715-e78a684b16cd (371e735b-3763-4b7c-a715-e78a684b16cd): created successfully Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392db77b-71db-47c1-a733-b7ebd7611402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Flow 'volume_create_manager' (0806137e-9ba3-4eaf-9823-ec3bcb73a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-da963252-bbfc-4460-977a-ac734d756776 tempest-VolumeDependencyTests-251350524 None] Created volume successfully. Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Created reservations ['21526a7e-e9da-4341-85c9-ed4bed0155b0', 'cb888590-dbb0-47ff-867c-64bca444c8ef', '8b8c85d0-43e7-4a4d-bc55-fb6a7f29aa3d', '9ec4737c-4482-43b3-b400-f51da68908f3'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:09 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:09 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Creating offline snapshot 13c0e15e-17bb-4ddd-9114-d1341e4d1a4e of volume 371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[27167b8f-7f0a-4a5d-8cb2-50905d4f6a5c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:10 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-28f2fd86-440d-4e3d-bf34-6134e54eec27" returned: 0 in 0.822s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Lock "cinder-quobyte-28f2fd86-440d-4e3d-bf34-6134e54eec27" released by "delete_volume" :: held 1.887s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:10 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd Jul 05 05:33:10 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Created reservations ['202ae073-bcaa-4ff3-9fae-f08e2301d1ba', 'f7126f50-4892-4b44-9ca1-4aeaa20c9aca', '198f0da0-d89b-4950-8c62-832311dd1cb9', '8958e880-6b26-4500-a377-58618a3f1bbd'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:10 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:10 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:10 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.887s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Deleted volume successfully. Jul 05 05:33:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-cc92fb28-35f7-4545-9842-2c7e19cce086 tempest-CreateVolumesFromSourceVolumeTest-406546607 None] Lock "cinder-d8b72977-f568-428f-bd23-636181988e2f-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:11 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.962s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:11 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:11 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Deleted volume successfully. Jul 05 05:33:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd" returned: 0 in 1.270s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-45fac069-e1db-4c10-9409-9d2c931be286 tempest-ProjectReaderTests-1550906713 None] Lock "cinder-28f2fd86-440d-4e3d-bf34-6134e54eec27-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:11 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e 1G Jul 05 05:33:11 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:12 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e 1G" returned: 0 in 0.935s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371e735b-3763-4b7c-a715-e78a684b16cd -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:12 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371e735b-3763-4b7c-a715-e78a684b16cd -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e Jul 05 05:33:12 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:12 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371e735b-3763-4b7c-a715-e78a684b16cd -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" returned: 0 in 0.786s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:12 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e is being set with open permissions: ugo+rw Jul 05 05:33:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:13 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e Jul 05 05:33:13 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:13 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" returned: 0 in 0.839s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:13 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.info Jul 05 05:33:13 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:14 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.info" returned: 0 in 0.885s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:14 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.info is being set with open permissions: ugo+rw Jul 05 05:33:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:14 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.info Jul 05 05:33:14 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:15 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.info" returned: 0 in 0.984s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.833s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ee18d6b3-6d61-4102-93ba-3fdec7cab2df tempest-VolumeDependencyTests-251350524 None] Create snapshot completed successfully Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-543e4b3e-7438-4648-8e85-bc2f8c98a593 tempest-ProjectAdminTests-860796221 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548027038574, 'free_capacity_gb': 1775.7548027038574, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86688) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (25dbd4fd-4263-4a23-8dbe-cb3724c43469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd764658-303a-4281-a452-51b18332bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd764658-303a-4281-a452-51b18332bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920648332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96da7f71-75fb-405a-8e45-ea8298e3c655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:16Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b6347f-531e-4f02-8188-6db13f349c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b6347f-531e-4f02-8188-6db13f349c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3ce43a-5d4f-4866-9d8d-cf62c8189c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3ce43a-5d4f-4866-9d8d-cf62c8189c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96da7f71-75fb-405a-8e45-ea8298e3c655', 'volume_name': 'volume-96da7f71-75fb-405a-8e45-ea8298e3c655', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb39cf89-929a-4d87-a52a-930cb539a3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb39cf89-929a-4d87-a52a-930cb539a3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93357d0a-815a-4ca4-b3a6-a897c1d0f327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:16 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Volume 96da7f71-75fb-405a-8e45-ea8298e3c655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96da7f71-75fb-405a-8e45-ea8298e3c655', 'volume_size': 1} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920648332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96da7f71-75fb-405a-8e45-ea8298e3c655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:16Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Creating volume 96da7f71-75fb-405a-8e45-ea8298e3c655 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:16 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:16 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 1073741824 Jul 05 05:33:16 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Flow 'volume_create_manager' (6a9ef4f1-e852-4532-a7a9-014747e3d305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e123ccbf-7484-4d4b-8b13-e364745e2a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e123ccbf-7484-4d4b-8b13-e364745e2a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1968500545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72530528-f836-4e9e-ac8d-2afab36b390b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed00ef1a42a044818cbb9d7365107253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=13c0e15e-17bb-4ddd-9114-d1341e4d1a4e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:17Z,use_quota=True,user_id='1fdf79c29fff4045b6502304d4da5fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c56dbc6-c7e1-4582-ab91-6c6c718428ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c56dbc6-c7e1-4582-ab91-6c6c718428ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28bb58d-71f2-45d0-877d-4db3024947dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28bb58d-71f2-45d0-877d-4db3024947dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72530528-f836-4e9e-ac8d-2afab36b390b', 'volume_name': 'volume-72530528-f836-4e9e-ac8d-2afab36b390b', 'volume_size': 1, 'snapshot_id': '13c0e15e-17bb-4ddd-9114-d1341e4d1a4e'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6675458-1cc7-4902-b19e-dab426beb70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6675458-1cc7-4902-b19e-dab426beb70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b512dc-986c-4ba1-aba1-875c8fe686ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:17 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Volume 72530528-f836-4e9e-ac8d-2afab36b390b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72530528-f836-4e9e-ac8d-2afab36b390b', 'volume_size': 1, 'snapshot_id': '13c0e15e-17bb-4ddd-9114-d1341e4d1a4e'} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:17 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 1073741824" returned: 0 in 1.236s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:17 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 Jul 05 05:33:17 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:18 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655" returned: 0 in 0.774s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.456s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-quobyte-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e-72530528-f836-4e9e-ac8d-2afab36b390b" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93357d0a-815a-4ca4-b3a6-a897c1d0f327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96da7f71-75fb-405a-8e45-ea8298e3c655', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea7bd15-e007-4895-a016-e57069fc4ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e-72530528-f836-4e9e-ac8d-2afab36b390b" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Creating volume 72530528-f836-4e9e-ac8d-2afab36b390b from snapshot 13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-quobyte-72530528-f836-4e9e-ac8d-2afab36b390b" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:18 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Volume volume-96da7f71-75fb-405a-8e45-ea8298e3c655 (96da7f71-75fb-405a-8e45-ea8298e3c655): created successfully Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea7bd15-e007-4895-a016-e57069fc4ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (25dbd4fd-4263-4a23-8dbe-cb3724c43469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-72530528-f836-4e9e-ac8d-2afab36b390b" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] snapshot: 13c0e15e-17bb-4ddd-9114-d1341e4d1a4e, volume: 72530528-f836-4e9e-ac8d-2afab36b390b, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-819320b5-e0e3-487b-980b-6e62ea3c50ad tempest-ProjectReaderTests-770280340 None] Created volume successfully. Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad76626-6188-4676-a70c-1a7a83337c72]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:19 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e Jul 05 05:33:19 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:19 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" returned: 0 in 0.959s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371e735b-3763-4b7c-a715-e78a684b16cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:33:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:33:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:33:19 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f2b1da-1d2a-497a-aaf3-8eedd00f26f6]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:19 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd Jul 05 05:33:19 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-96da7f71-75fb-405a-8e45-ea8298e3c655-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Lock "cinder-96da7f71-75fb-405a-8e45-ea8298e3c655-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-quobyte-96da7f71-75fb-405a-8e45-ea8298e3c655" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-96da7f71-75fb-405a-8e45-ea8298e3c655" acquired by "delete_volume" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a1738f-d4af-4c7c-98d7-ebfcedbbbc8c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:20 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 Jul 05 05:33:20 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:20 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd" returned: 0 in 1.053s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:33:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:20 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b Jul 05 05:33:20 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:21 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655" returned: 0 in 0.937s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:21 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655 Jul 05 05:33:21 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:22 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-96da7f71-75fb-405a-8e45-ea8298e3c655" returned: 0 in 0.955s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-96da7f71-75fb-405a-8e45-ea8298e3c655" released by "delete_volume" :: held 1.961s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Created reservations ['f7796bf3-ccef-4991-bfd3-293daf132ac8', '2d80b20b-fd1e-4868-9644-38cd23794684', '907dd9db-ddb5-46e9-83b9-a1dce3289a80', '3ab4ee9a-e2df-4988-ad32-333a3576227b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:22 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:22 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:23 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 1.309s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:23 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:23 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Deleted volume successfully. Jul 05 05:33:24 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4a264366-1cb3-4c31-8f37-1422a38bd0a9 tempest-ProjectReaderTests-770280340 None] Lock "cinder-96da7f71-75fb-405a-8e45-ea8298e3c655-delete_volume" released by "delete_volume" :: held 3.909s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (82b73646-b91c-4886-808d-a42145edca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f2ecec-c2a2-48bf-8de3-1d7b7a63ea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f2ecec-c2a2-48bf-8de3-1d7b7a63ea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892491163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723d248-b248-4e23-a847-2f6115773c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:25Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f424bea-f9eb-45ec-86cf-70ad815a8c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f424bea-f9eb-45ec-86cf-70ad815a8c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfad79b6-46e5-4fb4-9e1c-ea86393a7b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfad79b6-46e5-4fb4-9e1c-ea86393a7b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0723d248-b248-4e23-a847-2f6115773c60', 'volume_name': 'volume-0723d248-b248-4e23-a847-2f6115773c60', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188f389c-7962-4d93-800c-08dfa607851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188f389c-7962-4d93-800c-08dfa607851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc84207-bc77-499f-a092-06bbd2ca4874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:25 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Volume 0723d248-b248-4e23-a847-2f6115773c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0723d248-b248-4e23-a847-2f6115773c60', 'volume_size': 1} Jul 05 05:33:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:27 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b" returned: 0 in 6.915s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:27 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c554d9a-1e29-48f6-8446-2fb8ee1b9a2e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:27 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd Jul 05 05:33:27 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:28 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd" returned: 0 in 1.113s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:28 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:33:28 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Converted 1024.00 MB image at 148.07 MB/s Jul 05 05:33:28 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b is being set with open permissions: ugo+rw Jul 05 05:33:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:29 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b Jul 05 05:33:29 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:29 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b" returned: 0 in 0.707s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-72530528-f836-4e9e-ac8d-2afab36b390b" released by "_copy_volume_from_snapshot" :: held 10.890s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e-72530528-f836-4e9e-ac8d-2afab36b390b" released by "_create_volume_from_snapshot" :: held 10.951s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.011s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.029s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892491163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0723d248-b248-4e23-a847-2f6115773c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:25Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Creating volume 0723d248-b248-4e23-a847-2f6115773c60 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:29 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:29 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 1073741824 Jul 05 05:33:29 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55b512dc-986c-4ba1-aba1-875c8fe686ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72530528-f836-4e9e-ac8d-2afab36b390b', 'volume_size': 1, 'snapshot_id': '13c0e15e-17bb-4ddd-9114-d1341e4d1a4e'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a38f07a-1ede-4d30-9240-c6d1347c1a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:29 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Volume volume-72530528-f836-4e9e-ac8d-2afab36b390b (72530528-f836-4e9e-ac8d-2afab36b390b): created successfully Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a38f07a-1ede-4d30-9240-c6d1347c1a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:29 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Flow 'volume_create_manager' (6a9ef4f1-e852-4532-a7a9-014747e3d305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-42878d6b-2166-4b88-8579-24bb7bb55b28 tempest-VolumeDependencyTests-251350524 None] Created volume successfully. Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:30 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:30 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (9298df3d-1f6d-4f66-bf29-665c683764cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:30 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c64a7b-582c-49bb-920d-78e4699507db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 1073741824" returned: 0 in 1.167s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c64a7b-582c-49bb-920d-78e4699507db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761562828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8715cd9d-080e-432a-b93d-70b57cfdf684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:31Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e54eba-4f7b-47eb-81d1-ccb4778b1853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e54eba-4f7b-47eb-81d1-ccb4778b1853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d6aec1-1209-498a-8d1d-626c9bade760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d6aec1-1209-498a-8d1d-626c9bade760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8715cd9d-080e-432a-b93d-70b57cfdf684', 'volume_name': 'volume-8715cd9d-080e-432a-b93d-70b57cfdf684', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a987ca10-2254-4f1d-abf6-ef6221b9ed67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a987ca10-2254-4f1d-abf6-ef6221b9ed67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac15b9d-7dc2-453d-b240-d9b7b3c98bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:30 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Volume 8715cd9d-080e-432a-b93d-70b57cfdf684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8715cd9d-080e-432a-b93d-70b57cfdf684', 'volume_size': 1} Jul 05 05:33:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-quobyte-371e735b-3763-4b7c-a715-e78a684b16cd" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-371e735b-3763-4b7c-a715-e78a684b16cd" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-quobyte-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:31 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 Jul 05 05:33:31 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Deleting offline snapshot 13c0e15e-17bb-4ddd-9114-d1341e4d1a4e of volume 371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] snapshot_file for this snap is: volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f8cad-87de-4b88-8771-703d2882cdfe]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:31 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e Jul 05 05:33:31 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:31 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.878s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:33:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:33:32 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60" returned: 0 in 1.018s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761562828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8715cd9d-080e-432a-b93d-70b57cfdf684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:31Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Creating volume 8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:32 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:32 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 1073741824 Jul 05 05:33:32 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc84207-bc77-499f-a092-06bbd2ca4874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0723d248-b248-4e23-a847-2f6115773c60', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5110e712-cddf-49bf-a454-20a74d9287d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:32 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Volume volume-0723d248-b248-4e23-a847-2f6115773c60 (0723d248-b248-4e23-a847-2f6115773c60): created successfully Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5110e712-cddf-49bf-a454-20a74d9287d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (82b73646-b91c-4886-808d-a42145edca7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:32 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-6f2b3c95-20d2-41c5-b3c4-322d3979018b tempest-ProjectReaderTests-770280340 None] Created volume successfully. Jul 05 05:33:32 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" returned: 0 in 1.083s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371e735b-3763-4b7c-a715-e78a684b16cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1fd07-639e-46e6-8b14-bc56c409c7ff]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:32 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd Jul 05 05:33:32 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:32 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 1073741824" returned: 0 in 0.935s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:33 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Flow 'volume_create_manager' (364d431b-bd1e-4f4c-9ce7-6163ce65c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d23fbc-f5df-4d2f-9157-db70982e2fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd" returned: 0 in 0.866s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:33 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e Jul 05 05:33:33 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d23fbc-f5df-4d2f-9157-db70982e2fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-555436064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65a3608-39bf-46fd-8d76-b514895e1e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdef7cee3e0448cbec8bcf4f20fe607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:33Z,use_quota=True,user_id='8658d47e02ad4fe4bb02070387f0a4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ca9e74-03ca-4cfb-8247-6fc2212675a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ca9e74-03ca-4cfb-8247-6fc2212675a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da2c23-922f-4f23-a8d6-925cadbecda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:33 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 Jul 05 05:33:33 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97da2c23-922f-4f23-a8d6-925cadbecda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65a3608-39bf-46fd-8d76-b514895e1e17', 'volume_name': 'volume-a65a3608-39bf-46fd-8d76-b514895e1e17', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dcb0eb-3f6f-49de-b0f7-b1e687ea10af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dcb0eb-3f6f-49de-b0f7-b1e687ea10af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a31b6f-d588-47c5-ad4e-fa3760cb5e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:33 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Volume a65a3608-39bf-46fd-8d76-b514895e1e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65a3608-39bf-46fd-8d76-b514895e1e17', 'volume_size': 1} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-0723d248-b248-4e23-a847-2f6115773c60-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Lock "cinder-0723d248-b248-4e23-a847-2f6115773c60-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-quobyte-0723d248-b248-4e23-a847-2f6115773c60" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-0723d248-b248-4e23-a847-2f6115773c60" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7fa6b4-2ee2-4edb-bf81-f0b0900b6834]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:33 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 Jul 05 05:33:33 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:33 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684" returned: 0 in 0.728s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-555436064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65a3608-39bf-46fd-8d76-b514895e1e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdef7cee3e0448cbec8bcf4f20fe607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:33Z,use_quota=True,user_id='8658d47e02ad4fe4bb02070387f0a4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Creating volume a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:33 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:33 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 1073741824 Jul 05 05:33:33 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac15b9d-7dc2-453d-b240-d9b7b3c98bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8715cd9d-080e-432a-b93d-70b57cfdf684', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1015015c-9d39-42a5-8386-8619678ce0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:33 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:33 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Volume volume-8715cd9d-080e-432a-b93d-70b57cfdf684 (8715cd9d-080e-432a-b93d-70b57cfdf684): created successfully Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1015015c-9d39-42a5-8386-8619678ce0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (9298df3d-1f6d-4f66-bf29-665c683764cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" returned: 0 in 0.842s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-46874290-f2fc-4d6d-9c32-d226d6d17d5b tempest-ProjectReaderTests-1089172562 None] Created volume successfully. Jul 05 05:33:33 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e Jul 05 05:33:33 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:34 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60" returned: 0 in 0.860s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:34 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60 Jul 05 05:33:34 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:34 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd.13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" returned: 0 in 0.703s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:34 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e" released by "_delete_snapshot" :: held 3.614s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 1073741824" returned: 0 in 0.820s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-371e735b-3763-4b7c-a715-e78a684b16cd" released by "delete_snapshot" :: held 3.647s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:34 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 Jul 05 05:33:34 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Created reservations ['e15db79f-59a4-4723-b0eb-bff0371d4cc9', '4359cbfe-eb0b-42b9-bfae-71dccce7de1b', 'fca4b53f-2748-4020-ba44-36b05bf6346a', '6457ec78-095e-49fd-86b0-15efc24188d6'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:34 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Delete snapshot completed successfully. Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-36e9069e-bea6-4d16-8602-071b752e5223 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-13c0e15e-17bb-4ddd-9114-d1341e4d1a4e-delete_snapshot" released by "delete_snapshot" :: held 3.852s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:34 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-0723d248-b248-4e23-a847-2f6115773c60" returned: 0 in 0.675s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-0723d248-b248-4e23-a847-2f6115773c60" released by "delete_volume" :: held 1.587s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:34 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Created reservations ['2fff9042-5a4f-4259-b62d-dbff73058b19', '68da549e-d9c2-4d9d-9b1b-293c6f47712c', '4a7ad3e0-e0f2-419a-bb06-11ca5ad40b6d', '57cf905c-c18b-4251-9818-cabfd2259233'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:35 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:35 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-371e735b-3763-4b7c-a715-e78a684b16cd-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Lock "cinder-371e735b-3763-4b7c-a715-e78a684b16cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-quobyte-371e735b-3763-4b7c-a715-e78a684b16cd" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-371e735b-3763-4b7c-a715-e78a684b16cd" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b07f5-26f8-4b5f-b082-8767e3f5bfa0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:35 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17" returned: 0 in 0.747s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.235s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:35 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a31b6f-d588-47c5-ad4e-fa3760cb5e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65a3608-39bf-46fd-8d76-b514895e1e17', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:35 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595c6616-7b3e-42c9-8881-b222cd99c26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Creating offline snapshot e04c10d8-7184-4fa1-ab75-26b6de8aeca0 of volume 8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:33:35 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Volume volume-a65a3608-39bf-46fd-8d76-b514895e1e17 (a65a3608-39bf-46fd-8d76-b514895e1e17): created successfully Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595c6616-7b3e-42c9-8881-b222cd99c26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Flow 'volume_create_manager' (364d431b-bd1e-4f4c-9ce7-6163ce65c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[53942677-6048-4dc4-af29-412c16bfb2a5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-13df5ee7-af9f-4bf5-877b-ede164f59a24 tempest-SnapshotDependencyTests-1401520307 None] Created volume successfully. Jul 05 05:33:35 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 Jul 05 05:33:35 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:35 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.839s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Deleted volume successfully. Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0256cbf7-bfe0-49e3-b71e-619edbc45219 tempest-ProjectReaderTests-770280340 None] Lock "cinder-0723d248-b248-4e23-a847-2f6115773c60-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:35 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (7b770bcf-fd2e-48c2-a2ca-8f701b81170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bec575-98e4-498b-a018-bc93f88cef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bec575-98e4-498b-a018-bc93f88cef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891933181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c184fa6b-ecdb-4448-9aa5-ea17a90c02d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:36Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b313643-adf6-4e65-ba51-944aa2386920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b313643-adf6-4e65-ba51-944aa2386920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dc9e14-fcbe-4c11-9513-9e9ff9769e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dc9e14-fcbe-4c11-9513-9e9ff9769e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c184fa6b-ecdb-4448-9aa5-ea17a90c02d7', 'volume_name': 'volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f1ffb8-9f5c-48e3-8614-b020f2723cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f1ffb8-9f5c-48e3-8614-b020f2723cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945145a8-db43-4d5d-bf90-9bf186bf5999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Volume c184fa6b-ecdb-4448-9aa5-ea17a90c02d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7', 'volume_size': 1} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:36 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd" returned: 0 in 0.942s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:36 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd Jul 05 05:33:36 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:36 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684" returned: 0 in 0.929s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:36 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 1G Jul 05 05:33:36 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:36 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-371e735b-3763-4b7c-a715-e78a684b16cd" returned: 0 in 0.701s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-371e735b-3763-4b7c-a715-e78a684b16cd" released by "delete_volume" :: held 1.696s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Created reservations ['36fd282d-ef70-403c-b732-e2fcd9d530a3', 'b543e230-adf5-4aba-ba14-fc0844d2f930', '4f737542-d2ef-42ba-87f5-321fc8661814', '3afaf4da-51b8-4d37-bf5e-486eddcc533b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:37 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:37 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:37 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 1G" returned: 0 in 0.827s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8715cd9d-080e-432a-b93d-70b57cfdf684 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:37 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8715cd9d-080e-432a-b93d-70b57cfdf684 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 Jul 05 05:33:37 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-72530528-f836-4e9e-ac8d-2afab36b390b-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-72530528-f836-4e9e-ac8d-2afab36b390b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "cinder-quobyte-72530528-f836-4e9e-ac8d-2afab36b390b" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-72530528-f836-4e9e-ac8d-2afab36b390b" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddcc6a7-ef3d-46b5-8501-6206067b6d2b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:37 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b Jul 05 05:33:37 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:37 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.727s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Deleted volume successfully. Jul 05 05:33:37 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-72e69414-c105-4c48-be53-102589d4883f tempest-VolumeDependencyTests-251350524 None] Lock "cinder-371e735b-3763-4b7c-a715-e78a684b16cd-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:38 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8715cd9d-080e-432a-b93d-70b57cfdf684 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0" returned: 0 in 0.814s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:38 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 is being set with open permissions: ugo+rw Jul 05 05:33:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:38 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 Jul 05 05:33:38 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:38 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b" returned: 0 in 0.794s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:38 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b Jul 05 05:33:38 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:38 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0" returned: 0 in 0.656s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:38 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.info Jul 05 05:33:38 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:39 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-72530528-f836-4e9e-ac8d-2afab36b390b" returned: 0 in 0.672s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-quobyte-72530528-f836-4e9e-ac8d-2afab36b390b" released by "delete_volume" :: held 1.515s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Created reservations ['37541902-cca8-4f09-b120-9ad525b07276', '68a3621c-dc5b-47ce-991c-e5dc8cd49452', 'ad6dbc99-e093-46be-9234-33edbcb6fa9e', '69cc99e1-82be-4cbf-8cbb-2a23b4d0bc62'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:39 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:39 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:39 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.info" returned: 0 in 0.719s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:39 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.info is being set with open permissions: ugo+rw Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:39 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.info Jul 05 05:33:39 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:39 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.679s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:39 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:39 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Deleted volume successfully. Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-e69fa008-b59f-464f-a8cd-b9f0e3610d52 tempest-VolumeDependencyTests-251350524 None] Lock "cinder-72530528-f836-4e9e-ac8d-2afab36b390b-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:40 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.info" returned: 0 in 0.730s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.794s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.216s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891933181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c184fa6b-ecdb-4448-9aa5-ea17a90c02d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:36Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Creating volume c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:40 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:40 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 1073741824 Jul 05 05:33:40 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:40 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-709a78c3-d4ee-405b-804d-e929c16794a3 tempest-ProjectReaderTests-1089172562 None] Create snapshot completed successfully Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-e04c10d8-7184-4fa1-ab75-26b6de8aeca0-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-e04c10d8-7184-4fa1-ab75-26b6de8aeca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-8715cd9d-080e-432a-b93d-70b57cfdf684" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-8715cd9d-080e-432a-b93d-70b57cfdf684" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-e04c10d8-7184-4fa1-ab75-26b6de8aeca0" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-e04c10d8-7184-4fa1-ab75-26b6de8aeca0" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Deleting offline snapshot e04c10d8-7184-4fa1-ab75-26b6de8aeca0 of volume 8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] snapshot_file for this snap is: volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0953fc98-7151-4d3c-acc5-d06aa6a7cf0d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:41 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 Jul 05 05:33:41 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:41 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 1073741824" returned: 0 in 1.134s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:41 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 Jul 05 05:33:41 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:41 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0" returned: 0 in 1.012s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8715cd9d-080e-432a-b93d-70b57cfdf684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:33:41 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe92de-a85b-48ae-9ce8-b88a30733bb7]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:42 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 Jul 05 05:33:42 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:42 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7" returned: 0 in 0.771s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.722s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Creating offline snapshot 4f06258d-7c29-4226-8267-899eb68c21d2 of volume a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945145a8-db43-4d5d-bf90-9bf186bf5999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36edcd43-f3b9-492d-a704-5f7a15bca07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[070ad3c4-662c-421d-9bc4-9b3e4c4ac11d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:42 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Volume volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 (c184fa6b-ecdb-4448-9aa5-ea17a90c02d7): created successfully Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36edcd43-f3b9-492d-a704-5f7a15bca07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (7b770bcf-fd2e-48c2-a2ca-8f701b81170a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a1e06c82-5056-42b0-a501-76562d534895 tempest-ProjectReaderTests-770280340 None] Created volume successfully. Jul 05 05:33:42 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 Jul 05 05:33:42 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:42 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684" returned: 0 in 0.878s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:42 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 Jul 05 05:33:42 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:43 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Flow 'volume_create_manager' (05f802c2-d334-4d0c-88e0-d94068934b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f3aacf-99c0-43bc-9f2c-b9003c27faf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17" returned: 0 in 0.896s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f3aacf-99c0-43bc-9f2c-b9003c27faf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec43e62c-2db1-46ef-a591-5674409f2a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b31fb7fcf4b519740f8eec658a0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:43Z,use_quota=True,user_id='ed4e2d5101ee451eae66e9f4ec92d037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:43 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 1G Jul 05 05:33:43 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1f1472-97f7-49a3-9eda-7a1f5dd97fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1f1472-97f7-49a3-9eda-7a1f5dd97fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb75be8-bca1-486d-af92-45a1f0920a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb75be8-bca1-486d-af92-45a1f0920a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec43e62c-2db1-46ef-a591-5674409f2a1e', 'volume_name': 'volume-ec43e62c-2db1-46ef-a591-5674409f2a1e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd719b4-59dc-457f-824b-27dbd941bd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd719b4-59dc-457f-824b-27dbd941bd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46f5b69-b722-45d4-a88d-030287dedb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:43 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Volume ec43e62c-2db1-46ef-a591-5674409f2a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec43e62c-2db1-46ef-a591-5674409f2a1e', 'volume_size': 1} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Lock "cinder-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-quobyte-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2381e9cc-a400-44d3-8d84-d2a023acaae2]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:43 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 Jul 05 05:33:43 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:43 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0" returned: 0 in 0.862s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:43 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0 Jul 05 05:33:43 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:44 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 1G" returned: 0 in 0.861s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65a3608-39bf-46fd-8d76-b514895e1e17 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:44 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65a3608-39bf-46fd-8d76-b514895e1e17 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 Jul 05 05:33:44 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:44 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7" returned: 0 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:44 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7 Jul 05 05:33:44 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:44 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684.e04c10d8-7184-4fa1-ab75-26b6de8aeca0" returned: 0 in 0.695s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-e04c10d8-7184-4fa1-ab75-26b6de8aeca0" released by "_delete_snapshot" :: held 3.576s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-8715cd9d-080e-432a-b93d-70b57cfdf684" released by "delete_snapshot" :: held 3.622s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Created reservations ['6395ea31-8b63-4195-88cc-1674abb55036', 'c3b48e9f-0468-42a2-9ada-a61b9f070ecd', 'dd8fcb2d-0c02-495f-afe7-40c90a6050aa', 'b1902851-5c8d-407a-9ec5-dbf722af188b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Delete snapshot completed successfully. Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b9aae4be-77cf-4677-885f-d2a474f73e07 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-e04c10d8-7184-4fa1-ab75-26b6de8aeca0-delete_snapshot" released by "delete_snapshot" :: held 3.781s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:44 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a65a3608-39bf-46fd-8d76-b514895e1e17 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2" returned: 0 in 0.712s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:44 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 is being set with open permissions: ugo+rw Jul 05 05:33:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:44 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 Jul 05 05:33:44 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-8715cd9d-080e-432a-b93d-70b57cfdf684-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:45 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7" returned: 0 in 0.717s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7" released by "delete_volume" :: held 1.565s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Lock "cinder-8715cd9d-080e-432a-b93d-70b57cfdf684-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-8715cd9d-080e-432a-b93d-70b57cfdf684" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-8715cd9d-080e-432a-b93d-70b57cfdf684" acquired by "delete_volume" :: waited 0.025s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Created reservations ['4160c567-ed1f-413a-b18e-6a853f996c07', '8248f287-1f68-47b9-89a3-7a9709c5c331', '1c801283-4701-44ab-af44-7180a2ad2475', '2405ec1d-35de-4d82-9751-8a28d3704141'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a7ecc8-2e91-4fc1-ad1c-b3b64a889c10]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:45 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 Jul 05 05:33:45 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:45 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:45 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:45 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2" returned: 0 in 0.713s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:45 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.info Jul 05 05:33:45 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:46 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.712s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Deleted volume successfully. Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-61332a49-f3f4-4628-bec1-cd064f69257b tempest-ProjectReaderTests-770280340 None] Lock "cinder-c184fa6b-ecdb-4448-9aa5-ea17a90c02d7-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:46 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684" returned: 0 in 0.947s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:46 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684 Jul 05 05:33:46 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (ca0eb99d-f645-46ef-8189-11b31507d111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f3088d-02c0-421f-9bbb-e02e8ef97c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f3088d-02c0-421f-9bbb-e02e8ef97c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80513611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43fd914-0736-4a00-8508-03974bdb969c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:46Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa1a1d8-f5f8-49d2-a16a-5e37dcc3defd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa1a1d8-f5f8-49d2-a16a-5e37dcc3defd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1edda74-7e2e-42dc-b1de-dfc418d36de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1edda74-7e2e-42dc-b1de-dfc418d36de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43fd914-0736-4a00-8508-03974bdb969c', 'volume_name': 'volume-b43fd914-0736-4a00-8508-03974bdb969c', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c073cd66-13a0-4443-b86e-432bbb695a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c073cd66-13a0-4443-b86e-432bbb695a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:46 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9879e6-160a-490b-acc9-720f0551b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:46 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Volume b43fd914-0736-4a00-8508-03974bdb969c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43fd914-0736-4a00-8508-03974bdb969c', 'volume_size': 1} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.info" returned: 0 in 0.816s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:46 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.info is being set with open permissions: ugo+rw Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:46 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.info Jul 05 05:33:46 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:46 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-8715cd9d-080e-432a-b93d-70b57cfdf684" returned: 0 in 0.692s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-8715cd9d-080e-432a-b93d-70b57cfdf684" released by "delete_volume" :: held 1.694s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Created reservations ['c4a91094-4b41-4922-ac53-b6d9b9b4b9db', '9cde67e4-edf6-45cc-8fab-b3517b0e8f60', '4289781c-32b1-4e46-a486-3c9f7acc2c3a', '734d148f-a007-474f-946e-9aaeeb641dcb'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:46 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.info" returned: 0 in 0.668s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:47 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.773s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:47 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.772s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec43e62c-2db1-46ef-a591-5674409f2a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b31fb7fcf4b519740f8eec658a0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:43Z,use_quota=True,user_id='ed4e2d5101ee451eae66e9f4ec92d037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Creating volume ec43e62c-2db1-46ef-a591-5674409f2a1e {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:47 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:47 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e 1073741824 Jul 05 05:33:47 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-78a69c9a-9da1-4196-9f65-ddcd5f56655c tempest-SnapshotDependencyTests-1401520307 None] Create snapshot completed successfully Jul 05 05:33:47 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.690s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:47 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Deleted volume successfully. Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41cc000a-418d-407d-b7c4-4c19fc4facfe tempest-ProjectReaderTests-1089172562 None] Lock "cinder-8715cd9d-080e-432a-b93d-70b57cfdf684-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (40825f4d-a29c-48a3-8c35-42ffe78bb252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208838cc-c6d7-4f03-8e30-936b7f81e828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208838cc-c6d7-4f03-8e30-936b7f81e828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913859184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3068d9b-6a63-4fd4-8e84-bf932df30721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:48Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c73e5e-4d69-4641-a1fd-546143905cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c73e5e-4d69-4641-a1fd-546143905cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe2444e-da85-4f68-b28f-6cacfc2cafeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe2444e-da85-4f68-b28f-6cacfc2cafeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3068d9b-6a63-4fd4-8e84-bf932df30721', 'volume_name': 'volume-f3068d9b-6a63-4fd4-8e84-bf932df30721', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22695c81-b973-4339-bd07-2b7bb707bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22695c81-b973-4339-bd07-2b7bb707bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9394aad9-c883-4d07-9837-96929f4ec142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:47 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Volume f3068d9b-6a63-4fd4-8e84-bf932df30721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3068d9b-6a63-4fd4-8e84-bf932df30721', 'volume_size': 1} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:47 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e 1073741824" returned: 0 in 0.859s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:47 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e Jul 05 05:33:47 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:48 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e" returned: 0 in 0.672s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-80513611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43fd914-0736-4a00-8508-03974bdb969c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f99f4dc57c5e4681b9031a03729d06b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:46Z,use_quota=True,user_id='cfdb5ce70e814ad2a0ee3a2e4c5c7146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Creating volume b43fd914-0736-4a00-8508-03974bdb969c {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:48 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:48 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c 1073741824 Jul 05 05:33:48 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46f5b69-b722-45d4-a88d-030287dedb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec43e62c-2db1-46ef-a591-5674409f2a1e', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d51011e-d244-4e90-82ca-3e4c6b72d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:48 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Volume volume-ec43e62c-2db1-46ef-a591-5674409f2a1e (ec43e62c-2db1-46ef-a591-5674409f2a1e): created successfully Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d51011e-d244-4e90-82ca-3e4c6b72d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Flow 'volume_create_manager' (05f802c2-d334-4d0c-88e0-d94068934b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:48 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b7b6affc-4cd3-4584-8276-a8b2f0e66952 tempest-CinderUnicodeTest-1051521803 None] Created volume successfully. Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Flow 'volume_create_manager' (19225988-5ed0-42c7-8305-ba971cfa50de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66129afe-720c-47af-980d-73c743764149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66129afe-720c-47af-980d-73c743764149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8cf34e-99e3-4830-8417-b35a7023bb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdef7cee3e0448cbec8bcf4f20fe607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f06258d-7c29-4226-8267-899eb68c21d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:49Z,use_quota=True,user_id='8658d47e02ad4fe4bb02070387f0a4ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efad3de3-75f6-4ed6-b84b-09c10dee3148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efad3de3-75f6-4ed6-b84b-09c10dee3148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6b9eb8-ce35-4bbd-982c-9edfa7de85c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6b9eb8-ce35-4bbd-982c-9edfa7de85c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe8cf34e-99e3-4830-8417-b35a7023bb23', 'volume_name': 'volume-fe8cf34e-99e3-4830-8417-b35a7023bb23', 'volume_size': 1, 'snapshot_id': '4f06258d-7c29-4226-8267-899eb68c21d2'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52acf392-61ff-42e7-88da-60e00be28f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52acf392-61ff-42e7-88da-60e00be28f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdd36ab-94f3-4850-a2e2-9c3ea21ad89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:48 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Volume fe8cf34e-99e3-4830-8417-b35a7023bb23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe8cf34e-99e3-4830-8417-b35a7023bb23', 'volume_size': 1, 'snapshot_id': '4f06258d-7c29-4226-8267-899eb68c21d2'} Jul 05 05:33:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:49 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c 1073741824" returned: 0 in 0.851s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:49 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c Jul 05 05:33:49 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Flow 'volume_create_manager' (7f7e4fb8-f1e9-417d-be46-d1d975e0bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a844ad8-f9c2-4ad1-adb0-b539d8cb3dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a844ad8-f9c2-4ad1-adb0-b539d8cb3dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1677762048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e816d0b9-ebb6-4740-b38a-25bb17a43722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b31fb7fcf4b519740f8eec658a0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:50Z,use_quota=True,user_id='ed4e2d5101ee451eae66e9f4ec92d037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebafd46-7ab2-4c10-adce-84e4c54b4da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebafd46-7ab2-4c10-adce-84e4c54b4da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8456927-b854-44eb-8ddd-bfcd57af7ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8456927-b854-44eb-8ddd-bfcd57af7ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e816d0b9-ebb6-4740-b38a-25bb17a43722', 'volume_name': 'volume-e816d0b9-ebb6-4740-b38a-25bb17a43722', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d636bd4f-c39e-40c1-85c6-08c49271eb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d636bd4f-c39e-40c1-85c6-08c49271eb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188b5fa4-5351-4304-ae4e-754af7548bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Volume e816d0b9-ebb6-4740-b38a-25bb17a43722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e816d0b9-ebb6-4740-b38a-25bb17a43722', 'volume_size': 1} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:50 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c" returned: 0 in 0.688s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913859184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3068d9b-6a63-4fd4-8e84-bf932df30721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:48Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Creating volume f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:50 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9879e6-160a-490b-acc9-720f0551b25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43fd914-0736-4a00-8508-03974bdb969c', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:50 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 1073741824 Jul 05 05:33:50 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b50ef45-1cdb-47c7-a862-9e6cadecde45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:50 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Volume volume-b43fd914-0736-4a00-8508-03974bdb969c (b43fd914-0736-4a00-8508-03974bdb969c): created successfully Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b50ef45-1cdb-47c7-a862-9e6cadecde45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Flow 'volume_create_manager' (ca0eb99d-f645-46ef-8189-11b31507d111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-fde8f6ae-38d7-4733-8b97-297d63d6d081 tempest-ProjectReaderTests-770280340 None] Created volume successfully. Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-b43fd914-0736-4a00-8508-03974bdb969c-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Lock "cinder-b43fd914-0736-4a00-8508-03974bdb969c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Acquiring lock "cinder-quobyte-b43fd914-0736-4a00-8508-03974bdb969c" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-b43fd914-0736-4a00-8508-03974bdb969c" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a977e4-c70b-4b51-af56-786c8fa3b75c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:50 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c Jul 05 05:33:50 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:51 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 1073741824" returned: 0 in 0.886s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:51 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 Jul 05 05:33:51 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:51 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c" returned: 0 in 0.784s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:51 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c Jul 05 05:33:51 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:51 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721" returned: 0 in 0.645s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.932s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-quobyte-4f06258d-7c29-4226-8267-899eb68c21d2-fe8cf34e-99e3-4830-8417-b35a7023bb23" by "_create_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9394aad9-c883-4d07-9837-96929f4ec142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3068d9b-6a63-4fd4-8e84-bf932df30721', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d6b6ff-0448-4e09-9268-df6c0149b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-4f06258d-7c29-4226-8267-899eb68c21d2-fe8cf34e-99e3-4830-8417-b35a7023bb23" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Creating volume fe8cf34e-99e3-4830-8417-b35a7023bb23 from snapshot 4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-quobyte-fe8cf34e-99e3-4830-8417-b35a7023bb23" by "_copy_volume_from_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-fe8cf34e-99e3-4830-8417-b35a7023bb23" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] snapshot: 4f06258d-7c29-4226-8267-899eb68c21d2, volume: fe8cf34e-99e3-4830-8417-b35a7023bb23, {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 05:33:51 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Volume volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 (f3068d9b-6a63-4fd4-8e84-bf932df30721): created successfully Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d6b6ff-0448-4e09-9268-df6c0149b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (40825f4d-a29c-48a3-8c35-42ffe78bb252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b1878c28-6b4a-4d14-bf66-c3fc1a804b2e tempest-ProjectReaderTests-1089172562 None] Created volume successfully. Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6ce968-2590-4ef8-adbf-c94f8a5bd22e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:51 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b43fd914-0736-4a00-8508-03974bdb969c" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Lock "cinder-quobyte-b43fd914-0736-4a00-8508-03974bdb969c" released by "delete_volume" :: held 1.479s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:52 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 Jul 05 05:33:52 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Created reservations ['ebbd5b8d-d62e-4383-a2c6-eb2c034d64d9', '5ffc6a42-3dd2-496f-8d68-b46b84ec7410', '6f12d45d-4275-492e-8592-20f6e6d54a0c', 'bcdfea52-df19-4d60-9d0f-1cbaa7d5deb3'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:52 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:33:52 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:52 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2" returned: 0 in 0.836s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a65a3608-39bf-46fd-8d76-b514895e1e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Creating direct copy from snapshot {{(pid=86688) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d5f2df-1dc9-4dc4-881b-a2bd88e891de]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:52 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:33:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Deleted volume successfully. Jul 05 05:33:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-aefbfa37-2fa4-4729-90fd-d37e07255be0 tempest-ProjectReaderTests-770280340 None] Lock "cinder-b43fd914-0736-4a00-8508-03974bdb969c-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:52 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 Jul 05 05:33:52 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:53 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:53 devstack cinder-volume[86688]: DEBUG cinder.utils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Path /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 not found in is_blk_device check {{(pid=86688) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 05:33:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:53 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 Jul 05 05:33:53 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:58 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23" returned: 0 in 4.661s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:58 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aea2d66-17da-413c-82f4-7bfe7b34d856]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:33:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:58 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 Jul 05 05:33:58 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:59 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17" returned: 0 in 0.890s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Image conversion details: src /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 {{(pid=86688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 05:33:59 devstack cinder-volume[86688]: INFO cinder.image.image_utils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Converted 1024.00 MB image at 219.64 MB/s Jul 05 05:33:59 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 is being set with open permissions: ugo+rw Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:59 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 Jul 05 05:33:59 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:59 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23" returned: 0 in 0.643s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-fe8cf34e-99e3-4830-8417-b35a7023bb23" released by "_copy_volume_from_snapshot" :: held 7.946s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-4f06258d-7c29-4226-8267-899eb68c21d2-fe8cf34e-99e3-4830-8417-b35a7023bb23" released by "_create_volume_from_snapshot" :: held 7.975s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.014s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.680s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:33:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1677762048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e816d0b9-ebb6-4740-b38a-25bb17a43722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178b31fb7fcf4b519740f8eec658a0e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:33:50Z,use_quota=True,user_id='ed4e2d5101ee451eae66e9f4ec92d037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Creating volume e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:33:59 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:33:59 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 1073741824 Jul 05 05:33:59 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdd36ab-94f3-4850-a2e2-9c3ea21ad89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8cf34e-99e3-4830-8417-b35a7023bb23', 'volume_size': 1, 'snapshot_id': '4f06258d-7c29-4226-8267-899eb68c21d2'}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dce2ad-68a3-4b0e-b443-f4344c9dfdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:33:59 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Volume volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 (fe8cf34e-99e3-4830-8417-b35a7023bb23): created successfully Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dce2ad-68a3-4b0e-b443-f4344c9dfdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:33:59 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Flow 'volume_create_manager' (19225988-5ed0-42c7-8305-ba971cfa50de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:33:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-667207c5-c6ce-452f-821d-189018952979 tempest-SnapshotDependencyTests-1401520307 None] Created volume successfully. Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-4f06258d-7c29-4226-8267-899eb68c21d2-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-4f06258d-7c29-4226-8267-899eb68c21d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-quobyte-a65a3608-39bf-46fd-8d76-b514895e1e17" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-a65a3608-39bf-46fd-8d76-b514895e1e17" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-quobyte-4f06258d-7c29-4226-8267-899eb68c21d2" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-4f06258d-7c29-4226-8267-899eb68c21d2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Deleting offline snapshot 4f06258d-7c29-4226-8267-899eb68c21d2 of volume a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] snapshot_file for this snap is: volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:34:00 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 1073741824" returned: 0 in 0.784s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f5727-ab64-4196-844f-e3ae4e9800b3]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:00 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 Jul 05 05:34:00 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:00 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 Jul 05 05:34:00 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:01 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722" returned: 0 in 0.667s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.094s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188b5fa4-5351-4304-ae4e-754af7548bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e816d0b9-ebb6-4740-b38a-25bb17a43722', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb644b7-176e-4a06-b207-856f9c860fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Creating offline snapshot 29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b of volume f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:34:01 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2" returned: 0 in 0.772s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a65a3608-39bf-46fd-8d76-b514895e1e17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ea67fa-8aaf-4c08-a8c8-6963254f317b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:01 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Volume volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 (e816d0b9-ebb6-4740-b38a-25bb17a43722): created successfully Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb644b7-176e-4a06-b207-856f9c860fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Flow 'volume_create_manager' (7f7e4fb8-f1e9-417d-be46-d1d975e0bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a136ab-f250-481d-a421-5a05261c6e60]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:01 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-98eca02a-05bb-4728-a081-45c09a741949 tempest-CinderUnicodeTest-1051521803 None] Created volume successfully. Jul 05 05:34:01 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 Jul 05 05:34:01 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:01 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 Jul 05 05:34:01 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:02 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721" returned: 0 in 0.810s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:02 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b 1G Jul 05 05:34:02 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:02 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17" returned: 0 in 0.854s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:02 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 Jul 05 05:34:02 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:02 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b 1G" returned: 0 in 0.764s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:02 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2" returned: 0 in 0.725s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:03 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b Jul 05 05:34:03 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:03 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2 Jul 05 05:34:03 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:03 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17.4f06258d-7c29-4226-8267-899eb68c21d2" returned: 0 in 0.634s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-4f06258d-7c29-4226-8267-899eb68c21d2" released by "_delete_snapshot" :: held 3.123s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:03 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-a65a3608-39bf-46fd-8d76-b514895e1e17" released by "delete_snapshot" :: held 3.149s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" returned: 0 in 0.727s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:03 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b is being set with open permissions: ugo+rw Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:03 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b Jul 05 05:34:03 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Created reservations ['7eb388ce-2615-4e29-a478-1953ead5b13b', '8f017771-227e-418e-87f4-10d59ca00925', 'c1feb308-54a1-449d-9ba8-b88ae22f6749', '24f2ec60-37c9-4bd8-9351-29cbea0c782b'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Delete snapshot completed successfully. Jul 05 05:34:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a686eb55-68f9-4201-99f7-eb6e6c921747 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-4f06258d-7c29-4226-8267-899eb68c21d2-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:04 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" returned: 0 in 0.636s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:INSERT=42,cinder:UPDATE=136,cinder:SELECT=111,cinder:DELETE=11 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=104,cinder:INSERT=28,cinder:UPDATE=158,cinder:DELETE=16 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:04 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.info Jul 05 05:34:04 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-a65a3608-39bf-46fd-8d76-b514895e1e17-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-a65a3608-39bf-46fd-8d76-b514895e1e17-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-quobyte-a65a3608-39bf-46fd-8d76-b514895e1e17" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-a65a3608-39bf-46fd-8d76-b514895e1e17" acquired by "delete_volume" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e8318e-55fd-49d6-867a-eab855e0b5d1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:04 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 Jul 05 05:34:04 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:05 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.info" returned: 0 in 0.640s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:05 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.info is being set with open permissions: ugo+rw Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:05 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.info Jul 05 05:34:05 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:05 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.info" returned: 0 in 0.648s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.348s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.473s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:05 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Creating offline snapshot 3c548939-84d4-4376-adf6-470f791b6210 of volume e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17" returned: 0 in 0.816s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4761bee6-77ca-4651-b07e-bde448f43e56]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:05 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17 Jul 05 05:34:05 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:05 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c241b3e0-11a9-49be-a7cd-68cc006952a6 tempest-ProjectReaderTests-1089172562 None] Create snapshot completed successfully Jul 05 05:34:05 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 Jul 05 05:34:05 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:06 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a65a3608-39bf-46fd-8d76-b514895e1e17" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-a65a3608-39bf-46fd-8d76-b514895e1e17" released by "delete_volume" :: held 1.519s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Created reservations ['f6e66cef-5c1e-4eaa-b78d-342b1d6b4d52', 'd99c7c8c-303c-4c1c-8010-226339bd3b72', '56dd5ed5-cee8-4cbd-8b51-4a7d09b2d5d7', 'b1e50343-1b76-416b-a7e1-e095f90f6ad5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:06 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:06 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:06 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:06 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 1G Jul 05 05:34:06 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-f3068d9b-6a63-4fd4-8e84-bf932df30721" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-f3068d9b-6a63-4fd4-8e84-bf932df30721" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Deleting offline snapshot 29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b of volume f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] snapshot_file for this snap is: volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[99555a0d-5378-4d97-900f-059e1a69f2e1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-fe8cf34e-99e3-4830-8417-b35a7023bb23-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-fe8cf34e-99e3-4830-8417-b35a7023bb23-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "cinder-quobyte-fe8cf34e-99e3-4830-8417-b35a7023bb23" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-fe8cf34e-99e3-4830-8417-b35a7023bb23" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:07 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b Jul 05 05:34:07 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff77c602-6393-43f5-a7e2-521bb4dab5de]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:07 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.710s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Deleted volume successfully. Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-79ddd579-a581-4d3c-a330-2f69691c81d0 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-a65a3608-39bf-46fd-8d76-b514895e1e17-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:07 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 Jul 05 05:34:07 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:07 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 1G" returned: 0 in 0.919s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:07 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 Jul 05 05:34:07 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:07 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" returned: 0 in 0.875s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3068d9b-6a63-4fd4-8e84-bf932df30721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f0f114-ff1e-43da-a078-78fdd199073a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:07 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23" returned: 0 in 0.822s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:08 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23 Jul 05 05:34:08 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:08 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 Jul 05 05:34:08 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:08 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210" returned: 0 in 0.749s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:08 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 is being set with open permissions: ugo+rw Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:08 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 Jul 05 05:34:08 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:08 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:08 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-fe8cf34e-99e3-4830-8417-b35a7023bb23" returned: 0 in 0.707s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721" returned: 0 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-quobyte-fe8cf34e-99e3-4830-8417-b35a7023bb23" released by "delete_volume" :: held 1.578s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:08 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b Jul 05 05:34:08 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Created reservations ['3c9f14ac-ac02-4663-9607-d36836406a40', '7b53d6e1-922f-436f-8446-811af1bfacba', '31660b73-4015-47cc-bcbe-fa00645c74db', '2fbc0e7c-4a62-47a0-983e-341bb4eac0ca'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:08 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:08 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:08 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210" returned: 0 in 0.679s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:08 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.info Jul 05 05:34:08 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:09 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" returned: 0 in 0.834s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:09 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.716s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:09 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Deleted volume successfully. Jul 05 05:34:09 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b Jul 05 05:34:09 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:09 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.info" returned: 0 in 0.678s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:09 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b59e3ae7-713d-41c7-9aa7-9cc20d0d29a1 tempest-SnapshotDependencyTests-1401520307 None] Lock "cinder-fe8cf34e-99e3-4830-8417-b35a7023bb23-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:09 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.info is being set with open permissions: ugo+rw Jul 05 05:34:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:09 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.info Jul 05 05:34:09 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:10 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721.29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" returned: 0 in 0.698s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b" released by "_delete_snapshot" :: held 3.343s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-f3068d9b-6a63-4fd4-8e84-bf932df30721" released by "delete_snapshot" :: held 3.377s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Created reservations ['8d24f251-006a-409d-8f23-de09cc3235b3', 'ac038e0b-73a1-4404-9012-73d15d6d9f08', '57cbf91a-6577-4811-84fe-fa478d78960a', 'd7c8fe1d-218c-44f9-a381-050bc11d543c'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:10 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.info" returned: 0 in 0.753s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.685s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-65aa6607-385f-43d2-a1e8-604e07be2e92 tempest-CinderUnicodeTest-1051521803 None] Create snapshot completed successfully Jul 05 05:34:10 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Delete snapshot completed successfully. Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-18efbbe0-40a1-4252-884b-1ee2d03ad7a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-29f33ef8-0c72-4f5b-a268-f1bd8c65ec3b-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "cinder-3c548939-84d4-4376-adf6-470f791b6210-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-3c548939-84d4-4376-adf6-470f791b6210-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "cinder-quobyte-e816d0b9-ebb6-4740-b38a-25bb17a43722" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-e816d0b9-ebb6-4740-b38a-25bb17a43722" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "cinder-quobyte-3c548939-84d4-4376-adf6-470f791b6210" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-3c548939-84d4-4376-adf6-470f791b6210" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Deleting offline snapshot 3c548939-84d4-4376-adf6-470f791b6210 of volume e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] snapshot_file for this snap is: volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4f82d-d034-4ff2-8669-9f6426e4516d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:10 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 Jul 05 05:34:10 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-f3068d9b-6a63-4fd4-8e84-bf932df30721-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-f3068d9b-6a63-4fd4-8e84-bf932df30721-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-f3068d9b-6a63-4fd4-8e84-bf932df30721" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-f3068d9b-6a63-4fd4-8e84-bf932df30721" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a562b094-491e-4072-928a-472683f4aee1]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:11 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 Jul 05 05:34:11 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:11 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210" returned: 0 in 0.910s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e816d0b9-ebb6-4740-b38a-25bb17a43722(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3bf696-4819-4b84-9420-73159d851e71]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:11 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 Jul 05 05:34:11 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:12 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721" returned: 0 in 0.818s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:12 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721 Jul 05 05:34:12 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:12 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722" returned: 0 in 0.975s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:12 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 Jul 05 05:34:12 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:12 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f3068d9b-6a63-4fd4-8e84-bf932df30721" returned: 0 in 0.855s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-f3068d9b-6a63-4fd4-8e84-bf932df30721" released by "delete_volume" :: held 1.745s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:12 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Created reservations ['0786cedd-8b49-4bb0-9a72-62486041109e', 'df3c76a0-56ad-4eed-b187-825139093eeb', 'ca211ba9-8a52-4833-9d87-ebe3b0fd7565', '087b2e11-34ce-41f0-ba8b-c7f441f7e795'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:13 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:13 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:13 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210" returned: 0 in 0.904s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:13 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210 Jul 05 05:34:13 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:13 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.822s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Deleted volume successfully. Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-51ef04ca-acec-4d1c-a406-7c2c4aa0e001 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-f3068d9b-6a63-4fd4-8e84-bf932df30721-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (6ae64fec-62c1-4459-84b1-a96fad4b0201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed614f5-0571-4712-95ad-19c6ca50e0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed614f5-0571-4712-95ad-19c6ca50e0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1307986040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92e4f90-3d84-409a-8a63-f8fef8ab5fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:14Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f967c14-3b80-4e4c-957d-66cd192680f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:13 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f967c14-3b80-4e4c-957d-66cd192680f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326f759b-84dc-440d-a4e8-710c9ab2f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326f759b-84dc-440d-a4e8-710c9ab2f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a92e4f90-3d84-409a-8a63-f8fef8ab5fe0', 'volume_name': 'volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb3d37-c305-4651-9923-eb75ccf293d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb3d37-c305-4651-9923-eb75ccf293d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8570dc1c-db0f-4a8f-b010-1d29b1b9aef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:14 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Volume a92e4f90-3d84-409a-8a63-f8fef8ab5fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0', 'volume_size': 1} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1307986040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a92e4f90-3d84-409a-8a63-f8fef8ab5fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:14Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Creating volume a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:34:14 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:14 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 1073741824 Jul 05 05:34:14 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:14 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722.3c548939-84d4-4376-adf6-470f791b6210" returned: 0 in 0.792s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-3c548939-84d4-4376-adf6-470f791b6210" released by "_delete_snapshot" :: held 3.706s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-e816d0b9-ebb6-4740-b38a-25bb17a43722" released by "delete_snapshot" :: held 3.730s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Created reservations ['bba20cff-843b-49bf-86fb-ae3b796b3adc', '5db24ec1-73e4-4a18-bc1f-7aaa9e367e40', '17a61110-2934-4c23-8a3c-4cd707afde12', 'f82a0aa7-48b5-4491-89d4-8909791a5a2a'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:14 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Delete snapshot completed successfully. Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9d9e4b31-0740-4c2e-8648-47f413076a01 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-3c548939-84d4-4376-adf6-470f791b6210-delete_snapshot" released by "delete_snapshot" :: held 3.867s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "cinder-e816d0b9-ebb6-4740-b38a-25bb17a43722-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-e816d0b9-ebb6-4740-b38a-25bb17a43722-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "cinder-quobyte-e816d0b9-ebb6-4740-b38a-25bb17a43722" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:14 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-e816d0b9-ebb6-4740-b38a-25bb17a43722" acquired by "delete_volume" :: waited 0.038s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9674f8ce-3edb-4fc7-8d1b-ecc15dc24b69]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:15 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 1073741824" returned: 0 in 1.033s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:15 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 Jul 05 05:34:15 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:15 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 Jul 05 05:34:15 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0" returned: 0 in 0.675s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:15 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:15 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722" returned: 0 in 0.811s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8570dc1c-db0f-4a8f-b010-1d29b1b9aef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d652be7-b8cf-4e87-a60e-d392e27c2fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:15 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722 Jul 05 05:34:15 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:15 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Volume volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 (a92e4f90-3d84-409a-8a63-f8fef8ab5fe0): created successfully Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d652be7-b8cf-4e87-a60e-d392e27c2fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:15 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (6ae64fec-62c1-4459-84b1-a96fad4b0201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0261efc1-bd07-4da3-a39d-ba573060e7c8 tempest-ProjectReaderTests-1089172562 None] Created volume successfully. Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Creating offline snapshot 6320f1e9-4892-46ec-b215-c1a8324b685b of volume a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d186a0-9a3d-4b5f-ac5e-6a0931b65c4d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:16 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 Jul 05 05:34:16 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:16 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e816d0b9-ebb6-4740-b38a-25bb17a43722" returned: 0 in 0.865s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-e816d0b9-ebb6-4740-b38a-25bb17a43722" released by "delete_volume" :: held 1.762s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Created reservations ['364bc7ba-b71f-4acb-a8aa-360053ee120f', '6b11f35c-1f9c-41c9-ba5e-05e0ac6e1740', 'fb188085-3572-421a-8828-13427678c921', '474e2f05-a019-4e2e-a6b7-1077845fad86'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:16 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:16 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "cinder-ec43e62c-2db1-46ef-a591-5674409f2a1e-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-ec43e62c-2db1-46ef-a591-5674409f2a1e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "cinder-quobyte-ec43e62c-2db1-46ef-a591-5674409f2a1e" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-ec43e62c-2db1-46ef-a591-5674409f2a1e" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c54f4-1086-4280-954a-415abf67b4a0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:17 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0" returned: 0 in 1.002s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:17 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b 1G Jul 05 05:34:17 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:17 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e Jul 05 05:34:17 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:17 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.868s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Deleted volume successfully. Jul 05 05:34:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f97fd695-a255-465d-a38b-301ccec97b3b tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-e816d0b9-ebb6-4740-b38a-25bb17a43722-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:18 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:18 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b 1G" returned: 0 in 0.916s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e" returned: 0 in 1.000s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:18 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b Jul 05 05:34:18 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:18 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e Jul 05 05:34:18 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-ec43e62c-2db1-46ef-a591-5674409f2a1e" returned: 0 in 0.729s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:18 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-quobyte-ec43e62c-2db1-46ef-a591-5674409f2a1e" released by "delete_volume" :: held 1.813s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:19 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b" returned: 0 in 0.802s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:19 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b is being set with open permissions: ugo+rw Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:19 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b Jul 05 05:34:19 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Created reservations ['2533393a-1b80-44c4-bda5-603b4c35f902', '83338c5c-c116-4b70-a9cb-f4aad0238889', '51ce62cb-35bb-42e0-afd0-7504767e3ebc', '4aa36d46-f84f-471a-a803-7f4fd7954fd6'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:19 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:19 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:19 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.6320f1e9-4892-46ec-b215-c1a8324b685b" returned: 0 in 0.698s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:19 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.info Jul 05 05:34:19 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:19 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.781s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:19 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Deleted volume successfully. Jul 05 05:34:19 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-5ee12166-de7b-4fe9-a927-8182cd6dbc52 tempest-CinderUnicodeTest-1051521803 None] Lock "cinder-ec43e62c-2db1-46ef-a591-5674409f2a1e-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:20 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.info" returned: 0 in 0.708s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:20 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.info is being set with open permissions: ugo+rw Jul 05 05:34:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:20 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.info Jul 05 05:34:20 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:21 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-a92e4f90-3d84-409a-8a63-f8fef8ab5fe0.info" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.924s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:21 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d511a653-09cc-4f80-9560-476a37d2a0da tempest-ProjectReaderTests-1089172562 None] Create snapshot completed successfully Jul 05 05:34:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f46ff783-b0ee-4c09-baf7-96cc005399a7 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-6320f1e9-4892-46ec-b215-c1a8324b685b-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f46ff783-b0ee-4c09-baf7-96cc005399a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-6320f1e9-4892-46ec-b215-c1a8324b685b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:21 devstack cinder-volume[86688]: INFO cinder.message.api [None req-f46ff783-b0ee-4c09-baf7-96cc005399a7 tempest-ProjectReaderTests-1089172562 None] Creating message record for request_id = req-f46ff783-b0ee-4c09-baf7-96cc005399a7 Jul 05 05:34:21 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-f46ff783-b0ee-4c09-baf7-96cc005399a7 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-6320f1e9-4892-46ec-b215-c1a8324b685b-delete_snapshot" released by "delete_snapshot" :: held 0.037s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server [None req-f46ff783-b0ee-4c09-baf7-96cc005399a7 tempest-ProjectReaderTests-1089172562 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 05:34:21 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (de93a0ab-fd8c-46be-88d1-a2f373117d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4042d6-3b1a-46f9-a79d-eb3b35ae501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4042d6-3b1a-46f9-a79d-eb3b35ae501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061673581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f461c4f0-a925-4e74-9627-718da12c4933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:23Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f019818-ce42-40ba-b4fb-0b5ff29fd263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f019818-ce42-40ba-b4fb-0b5ff29fd263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffe81d4-e5ff-4389-8423-544abada0a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffe81d4-e5ff-4389-8423-544abada0a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f461c4f0-a925-4e74-9627-718da12c4933', 'volume_name': 'volume-f461c4f0-a925-4e74-9627-718da12c4933', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd973559-75b2-428c-9d55-933a44f36292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd973559-75b2-428c-9d55-933a44f36292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d72760-feb9-44c1-a962-f9c191ca2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:23 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Volume f461c4f0-a925-4e74-9627-718da12c4933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f461c4f0-a925-4e74-9627-718da12c4933', 'volume_size': 1} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061673581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f461c4f0-a925-4e74-9627-718da12c4933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:23Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Creating volume f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:34:23 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:23 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 1073741824 Jul 05 05:34:23 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:23 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 1073741824" returned: 0 in 0.818s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:23 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 Jul 05 05:34:23 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:24 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933" returned: 0 in 0.639s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:34:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d72760-feb9-44c1-a962-f9c191ca2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f461c4f0-a925-4e74-9627-718da12c4933', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb4f6ff-b917-4fb3-a3b5-9a35d7c73f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:24 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Volume volume-f461c4f0-a925-4e74-9627-718da12c4933 (f461c4f0-a925-4e74-9627-718da12c4933): created successfully Jul 05 05:34:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb4f6ff-b917-4fb3-a3b5-9a35d7c73f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:24 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (de93a0ab-fd8c-46be-88d1-a2f373117d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-db032e65-024f-4b60-8736-2a6b2e0d3d47 tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:34:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Creating offline snapshot cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c of volume f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:34:25 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c972cd9-067b-4672-81dc-bb958d40b693]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:25 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 Jul 05 05:34:25 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:26 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933" returned: 0 in 0.736s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:26 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c 1G Jul 05 05:34:26 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:26 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c 1G" returned: 0 in 0.760s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f461c4f0-a925-4e74-9627-718da12c4933 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:26 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f461c4f0-a925-4e74-9627-718da12c4933 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c Jul 05 05:34:26 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:27 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f461c4f0-a925-4e74-9627-718da12c4933 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" returned: 0 in 0.684s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:27 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c is being set with open permissions: ugo+rw Jul 05 05:34:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:27 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c Jul 05 05:34:27 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:28 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" returned: 0 in 0.635s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:28 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.info Jul 05 05:34:28 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:28 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.info" returned: 0 in 0.620s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:28 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.info is being set with open permissions: ugo+rw Jul 05 05:34:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:28 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.info Jul 05 05:34:28 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:29 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.info" returned: 0 in 0.627s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.142s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-08e5deb9-397e-4493-9a0a-8be88fb8bf83 tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Lock "cinder-cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-f461c4f0-a925-4e74-9627-718da12c4933" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f461c4f0-a925-4e74-9627-718da12c4933" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c of volume f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb3c571-736e-4659-b424-f22e4e4c9d6c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:30 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:30 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:30 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c Jul 05 05:34:30 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:31 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.660s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:34:31 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" returned: 0 in 0.750s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f461c4f0-a925-4e74-9627-718da12c4933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31d5eeb-274e-41f4-80ec-9ab900e3db4d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:31 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 Jul 05 05:34:31 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:32 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933" returned: 0 in 0.752s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:32 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c Jul 05 05:34:32 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:32 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" returned: 0 in 0.722s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:32 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c Jul 05 05:34:32 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:33 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933.cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" returned: 0 in 0.619s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c" released by "_delete_snapshot" :: held 2.952s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f461c4f0-a925-4e74-9627-718da12c4933" released by "delete_snapshot" :: held 2.973s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Created reservations ['a7dc9fe2-88b9-40e8-8615-624082b0468b', 'a8d1d8a2-2edb-44de-8dff-ada588b0ca3c', 'f0c292d0-a230-437b-b4e6-2c3b0402a6c9', 'a5f153bd-6576-4c5c-bf43-0bccffbe805e'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-11488f02-9179-45ab-bb2c-4b2a54222e3a tempest-ProjectMemberTests-605116020 None] Lock "cinder-cf1c6a67-f99e-4eba-87a6-f8b0521f9d1c-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-f461c4f0-a925-4e74-9627-718da12c4933-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Lock "cinder-f461c4f0-a925-4e74-9627-718da12c4933-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-f461c4f0-a925-4e74-9627-718da12c4933" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f461c4f0-a925-4e74-9627-718da12c4933" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896c4f3-febd-479b-a3a5-d1a0ea993865]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:33 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 Jul 05 05:34:33 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:34 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933" returned: 0 in 0.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:34 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933 Jul 05 05:34:34 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:35 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f461c4f0-a925-4e74-9627-718da12c4933" returned: 0 in 0.647s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f461c4f0-a925-4e74-9627-718da12c4933" released by "delete_volume" :: held 1.446s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Created reservations ['cc2a0939-96cc-464e-8350-e6b7b04d11a6', 'ba64db3c-6b29-458d-9b1e-0422298f7267', '91d4401e-8aa9-4bf5-a700-6b155a93f969', 'c1c2667c-57d3-410c-8bda-afa3aafea877'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:35 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:35 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:35 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.650s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:35 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:35 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-3593967a-80aa-4eaa-8537-3f13b469f8e8 tempest-ProjectMemberTests-605116020 None] Lock "cinder-f461c4f0-a925-4e74-9627-718da12c4933-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (193222a6-b666-49a2-ae4c-8a5813a156f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23640780-9305-4888-8a00-4668d71ca5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23640780-9305-4888-8a00-4668d71ca5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708333280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4625e0-57a7-45bc-ac9a-3f4a569cc7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:36Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f70bae-7a20-4254-910f-e17515d331bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f70bae-7a20-4254-910f-e17515d331bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b56206-d00c-4653-bbc5-3875d00f049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b56206-d00c-4653-bbc5-3875d00f049b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4625e0-57a7-45bc-ac9a-3f4a569cc7af', 'volume_name': 'volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc712724-6c80-48fd-bd2c-c56837772107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc712724-6c80-48fd-bd2c-c56837772107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3724d0a2-435f-4daf-a71d-8e502d2b899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:36 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Volume 1c4625e0-57a7-45bc-ac9a-3f4a569cc7af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af', 'volume_size': 1} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708333280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4625e0-57a7-45bc-ac9a-3f4a569cc7af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:36Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Creating volume 1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:34:36 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:34:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:36 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af 1073741824 Jul 05 05:34:36 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:37 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af 1073741824" returned: 0 in 0.810s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:37 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af Jul 05 05:34:37 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:37 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" returned: 0 in 0.628s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3724d0a2-435f-4daf-a71d-8e502d2b899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579e961b-e18f-4276-a0bc-2afb1e9a7c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:37 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Volume volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af (1c4625e0-57a7-45bc-ac9a-3f4a569cc7af): created successfully Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579e961b-e18f-4276-a0bc-2afb1e9a7c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:37 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (193222a6-b666-49a2-ae4c-8a5813a156f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:37 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-2a94956e-a441-4f34-a6ce-8987153a4e5a tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:34:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 691bef75-99ac-4d46-bfb4-91904252981f of volume 1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:34:38 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea1fe66-fdb8-4329-a949-21cc87d0144b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:38 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af Jul 05 05:34:38 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:39 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" returned: 0 in 0.734s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:39 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f 1G Jul 05 05:34:39 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:40 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f 1G" returned: 0 in 0.786s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:40 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f Jul 05 05:34:40 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:40 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:40 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f is being set with open permissions: ugo+rw Jul 05 05:34:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:40 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f Jul 05 05:34:40 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:41 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f" returned: 0 in 0.657s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:41 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.info Jul 05 05:34:41 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:42 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.info" returned: 0 in 0.696s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:42 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.info is being set with open permissions: ugo+rw Jul 05 05:34:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:42 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.info Jul 05 05:34:42 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:42 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.info" returned: 0 in 0.639s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.293s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f0174cae-b92e-4e1c-a5ae-cc9db04aa816 tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-691bef75-99ac-4d46-bfb4-91904252981f-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Lock "cinder-691bef75-99ac-4d46-bfb4-91904252981f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-691bef75-99ac-4d46-bfb4-91904252981f" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-691bef75-99ac-4d46-bfb4-91904252981f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot 691bef75-99ac-4d46-bfb4-91904252981f of volume 1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c21eb9-59ae-48dd-8001-0c8fbd27babf]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:43 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f Jul 05 05:34:43 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:44 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f" returned: 0 in 0.751s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:34:44 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bc02e4-4b0f-4124-b2b4-62ba674a5a2c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:44 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af Jul 05 05:34:44 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:45 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" returned: 0 in 0.787s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:45 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f Jul 05 05:34:45 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:46 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f" returned: 0 in 0.718s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:46 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f Jul 05 05:34:46 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:46 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af.691bef75-99ac-4d46-bfb4-91904252981f" returned: 0 in 0.625s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-691bef75-99ac-4d46-bfb4-91904252981f" released by "_delete_snapshot" :: held 2.974s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" released by "delete_snapshot" :: held 2.993s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Created reservations ['a8cc34d4-19aa-4220-be39-1c83de112e89', 'e4cd24ba-8cca-4f45-b908-6b833847e7c2', 'abbb935c-8388-4700-939e-f021bbd16c29', '1a477420-a36d-4f82-b51c-236288434367'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-8331da79-e00f-47ec-be27-778a983f64ba tempest-ProjectMemberTests-605116020 None] Lock "cinder-691bef75-99ac-4d46-bfb4-91904252981f-delete_snapshot" released by "delete_snapshot" :: held 3.121s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Lock "cinder-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" acquired by "delete_volume" :: waited 0.020s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37cfa89-65f2-4a5d-b3a5-627183ad4c5b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:47 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af Jul 05 05:34:47 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:47 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" returned: 0 in 0.760s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:47 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af Jul 05 05:34:47 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:48 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" returned: 0 in 0.655s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af" released by "delete_volume" :: held 1.469s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Created reservations ['415a07fe-dcf2-45d8-a21d-723ae4e43e6b', '3bfa060a-b57c-43c5-99f8-655e3872172c', '3292c815-8cf4-4b75-b31a-7b24905bd178', '5ebcaa20-c155-44c8-bb4a-ab7566eae911'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:48 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:34:48 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:49 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.649s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:34:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-986278ca-a8c9-484e-8c57-618d58088dcd tempest-ProjectMemberTests-605116020 None] Lock "cinder-1c4625e0-57a7-45bc-ac9a-3f4a569cc7af-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (7c5c0073-da78-4a69-84db-04e426c954ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393c5741-3ae9-4083-b112-1c83556cbb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (393c5741-3ae9-4083-b112-1c83556cbb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109669261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bce90b4-699a-4995-b981-07494ed3be7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:50Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ed6328-15ae-43b9-ad64-c93776429a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ed6328-15ae-43b9-ad64-c93776429a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b095061-ed7b-4406-b948-3cee9c5d0231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b095061-ed7b-4406-b948-3cee9c5d0231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bce90b4-699a-4995-b981-07494ed3be7f', 'volume_name': 'volume-5bce90b4-699a-4995-b981-07494ed3be7f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8250a1f0-3709-446f-8c0c-e397d38af7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8250a1f0-3709-446f-8c0c-e397d38af7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5f3542-d7f7-4a87-a9e0-b94319830bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:49 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Volume 5bce90b4-699a-4995-b981-07494ed3be7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bce90b4-699a-4995-b981-07494ed3be7f', 'volume_size': 1} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109669261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bce90b4-699a-4995-b981-07494ed3be7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:34:50Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Creating volume 5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:34:49 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:34:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:49 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f 1073741824 Jul 05 05:34:49 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:50 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f 1073741824" returned: 0 in 0.812s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:50 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f Jul 05 05:34:50 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:51 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f" returned: 0 in 0.633s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5f3542-d7f7-4a87-a9e0-b94319830bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bce90b4-699a-4995-b981-07494ed3be7f', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17160f34-bc16-4cf0-870f-e7b531a2c7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:34:51 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Volume volume-5bce90b4-699a-4995-b981-07494ed3be7f (5bce90b4-699a-4995-b981-07494ed3be7f): created successfully Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17160f34-bc16-4cf0-870f-e7b531a2c7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (7c5c0073-da78-4a69-84db-04e426c954ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:34:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-8f1c577c-01e0-402b-8318-56cefef2b258 tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Creating offline snapshot fb68c3b0-b894-4360-a280-96543206e468 of volume 5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dd7f46-9054-48df-928b-8ef4dde8a840]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:51 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f Jul 05 05:34:51 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:52 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f" returned: 0 in 0.754s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:52 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 1G Jul 05 05:34:52 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:53 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 1G" returned: 0 in 0.778s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bce90b4-699a-4995-b981-07494ed3be7f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:53 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bce90b4-699a-4995-b981-07494ed3be7f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 Jul 05 05:34:53 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:54 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bce90b4-699a-4995-b981-07494ed3be7f -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468" returned: 0 in 0.674s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:54 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 is being set with open permissions: ugo+rw Jul 05 05:34:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:54 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 Jul 05 05:34:54 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:54 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468" returned: 0 in 0.654s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:54 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.info Jul 05 05:34:54 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:55 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.info" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:55 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.info is being set with open permissions: ugo+rw Jul 05 05:34:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:55 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.info Jul 05 05:34:55 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:56 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.info" returned: 0 in 0.632s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.210s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:34:56 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d5a3d559-d023-4a14-9085-404c66089d88 tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-fb68c3b0-b894-4360-a280-96543206e468-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Lock "cinder-fb68c3b0-b894-4360-a280-96543206e468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-5bce90b4-699a-4995-b981-07494ed3be7f" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-5bce90b4-699a-4995-b981-07494ed3be7f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-fb68c3b0-b894-4360-a280-96543206e468" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-fb68c3b0-b894-4360-a280-96543206e468" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot fb68c3b0-b894-4360-a280-96543206e468 of volume 5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[476ecda5-a300-4e1c-a3c4-5a3071b758aa]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:57 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 Jul 05 05:34:57 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:57 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468" returned: 0 in 0.736s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bce90b4-699a-4995-b981-07494ed3be7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4348bd-964f-4eee-bf75-01f88a1ead13]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:34:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:58 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f Jul 05 05:34:58 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:58 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f" returned: 0 in 0.733s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:58 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 Jul 05 05:34:58 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:59 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468" returned: 0 in 0.709s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:34:59 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468 Jul 05 05:34:59 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:34:59 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 05 05:34:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f.fb68c3b0-b894-4360-a280-96543206e468" returned: 0 in 0.623s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:34:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-fb68c3b0-b894-4360-a280-96543206e468" released by "_delete_snapshot" :: held 2.890s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-5bce90b4-699a-4995-b981-07494ed3be7f" released by "delete_snapshot" :: held 2.912s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Created reservations ['6ea23502-6073-4255-8fb8-7cb9bda083b4', '1b9a60e2-6d2c-4927-bc62-29acd50ada86', '2a9b34bd-6a19-44f0-b5d8-11a1d037321d', 'ab937d7e-288f-4f97-a43a-59d3ee6cc223'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:35:00 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c71c06a-1a58-4383-b28e-671325724a9c tempest-ProjectMemberTests-605116020 None] Lock "cinder-fb68c3b0-b894-4360-a280-96543206e468-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-5bce90b4-699a-4995-b981-07494ed3be7f-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Lock "cinder-5bce90b4-699a-4995-b981-07494ed3be7f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-5bce90b4-699a-4995-b981-07494ed3be7f" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-5bce90b4-699a-4995-b981-07494ed3be7f" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d9647-d6bb-4959-b39e-871a6ec6aebc]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:35:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:00 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f Jul 05 05:35:00 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:01 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f" returned: 0 in 0.744s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:01 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f Jul 05 05:35:01 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:01 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-5bce90b4-699a-4995-b981-07494ed3be7f" returned: 0 in 0.641s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-5bce90b4-699a-4995-b981-07494ed3be7f" released by "delete_volume" :: held 1.438s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Created reservations ['38ff54cf-d769-40f9-9088-577e8b732abc', '97feb41d-a991-456e-aa30-f3398a185b9d', 'f3ecb834-b7a8-472f-8d8d-bf94c1c57bf8', '2d79e77c-1c7b-49aa-bfa5-23059259f107'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:01 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:35:01 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:02 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.671s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:35:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-dbb7337a-c791-4316-b8d0-6c2041d13fc7 tempest-ProjectMemberTests-605116020 None] Lock "cinder-5bce90b4-699a-4995-b981-07494ed3be7f-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (5103d6c2-2b37-49a0-8e6d-0f7de2ac00d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce99dbc0-2212-4610-8b83-b65306c3f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce99dbc0-2212-4610-8b83-b65306c3f435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295964403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878872d3-d8b2-4be3-9416-65fb0866a492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:35:03Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf7cb49-d919-4d90-b1f2-169ba10401a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:02 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf7cb49-d919-4d90-b1f2-169ba10401a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e8d664-277c-4714-a58d-756659d5d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e8d664-277c-4714-a58d-756659d5d17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878872d3-d8b2-4be3-9416-65fb0866a492', 'volume_name': 'volume-878872d3-d8b2-4be3-9416-65fb0866a492', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36351b2-123b-496c-8ca4-bb517a9257c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36351b2-123b-496c-8ca4-bb517a9257c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1b6503-819b-4661-874f-30e639b9677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:03 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Volume 878872d3-d8b2-4be3-9416-65fb0866a492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878872d3-d8b2-4be3-9416-65fb0866a492', 'volume_size': 1} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1295964403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878872d3-d8b2-4be3-9416-65fb0866a492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:35:03Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Creating volume 878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:35:03 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:03 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 1073741824 Jul 05 05:35:03 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:03 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 1073741824" returned: 0 in 0.826s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:03 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 Jul 05 05:35:03 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:04 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492" returned: 0 in 0.626s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=88,cinder:UPDATE=108,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1b6503-819b-4661-874f-30e639b9677b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878872d3-d8b2-4be3-9416-65fb0866a492', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729bcc52-fa2f-4c0d-aec3-ed522ac90909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=94,cinder:INSERT=36,cinder:UPDATE=121,cinder:DELETE=11 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:35:04 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Volume volume-878872d3-d8b2-4be3-9416-65fb0866a492 (878872d3-d8b2-4be3-9416-65fb0866a492): created successfully Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729bcc52-fa2f-4c0d-aec3-ed522ac90909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:04 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (5103d6c2-2b37-49a0-8e6d-0f7de2ac00d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:35:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c74f16fd-386b-477b-a635-c22c6e4f61d4 tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:35:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 2e616d14-5d5c-42c2-844e-11296cf34158 of volume 878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:35:05 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbbeb70-bf01-45fa-b574-036e39fa53a2]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:35:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:05 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 Jul 05 05:35:05 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:05 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:06 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 1G Jul 05 05:35:06 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:06 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 1G" returned: 0 in 0.788s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878872d3-d8b2-4be3-9416-65fb0866a492 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:06 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878872d3-d8b2-4be3-9416-65fb0866a492 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 Jul 05 05:35:06 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:07 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878872d3-d8b2-4be3-9416-65fb0866a492 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158" returned: 0 in 0.696s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:07 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 is being set with open permissions: ugo+rw Jul 05 05:35:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:07 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 Jul 05 05:35:07 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:08 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:08 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.info Jul 05 05:35:08 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:08 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.info" returned: 0 in 0.653s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:08 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.info is being set with open permissions: ugo+rw Jul 05 05:35:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:08 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.info Jul 05 05:35:08 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:09 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.info" returned: 0 in 0.674s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.327s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:09 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c160920b-70ee-40b3-aed6-51b82dc9d03d tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-2e616d14-5d5c-42c2-844e-11296cf34158-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Lock "cinder-2e616d14-5d5c-42c2-844e-11296cf34158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-878872d3-d8b2-4be3-9416-65fb0866a492" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-878872d3-d8b2-4be3-9416-65fb0866a492" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-2e616d14-5d5c-42c2-844e-11296cf34158" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-2e616d14-5d5c-42c2-844e-11296cf34158" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot 2e616d14-5d5c-42c2-844e-11296cf34158 of volume 878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd72be-353d-4ce6-a4a4-2d7fd5fe9e03]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:35:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:10 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 Jul 05 05:35:10 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:11 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158" returned: 0 in 0.758s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:11 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-878872d3-d8b2-4be3-9416-65fb0866a492(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:35:11 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4b008-62a0-4bd0-b4bf-b913c58be6b9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:35:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:11 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 Jul 05 05:35:11 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:11 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492" returned: 0 in 0.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:12 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 Jul 05 05:35:12 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:12 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158" returned: 0 in 0.705s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:12 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158 Jul 05 05:35:12 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:13 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492.2e616d14-5d5c-42c2-844e-11296cf34158" returned: 0 in 0.652s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-2e616d14-5d5c-42c2-844e-11296cf34158" released by "_delete_snapshot" :: held 2.947s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-878872d3-d8b2-4be3-9416-65fb0866a492" released by "delete_snapshot" :: held 2.969s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Created reservations ['d4f27802-c6bd-46d1-95b8-f0cbc74557e9', '3f6bec7d-f714-4331-b8ad-10275c3be6df', '2645374b-2c0e-47c5-96c9-0a2c0e5f289f', 'f5b99e9a-20cc-4312-a817-921142fc17c0'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:35:13 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-b2f08a86-265c-4631-af98-8082f89ba6bb tempest-ProjectMemberTests-605116020 None] Lock "cinder-2e616d14-5d5c-42c2-844e-11296cf34158-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-878872d3-d8b2-4be3-9416-65fb0866a492-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Lock "cinder-878872d3-d8b2-4be3-9416-65fb0866a492-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-878872d3-d8b2-4be3-9416-65fb0866a492" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-878872d3-d8b2-4be3-9416-65fb0866a492" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9eaf9c-3619-4868-a820-26d05c3572e7]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:35:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:13 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 Jul 05 05:35:13 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:14 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492" returned: 0 in 0.750s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:14 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492 Jul 05 05:35:14 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:15 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-878872d3-d8b2-4be3-9416-65fb0866a492" returned: 0 in 0.631s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-878872d3-d8b2-4be3-9416-65fb0866a492" released by "delete_volume" :: held 1.434s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Created reservations ['e6d24cd3-6742-400e-9ca7-c0eb013287cc', '1a4e6683-88b7-434d-9fab-ad131294357d', '18176a3a-5151-43f2-aa86-a1907606b421', '4817ae18-99dc-41c8-a5f5-52c12e8d2e0f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:15 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:35:15 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:15 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.641s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:35:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:35:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-1c7244ac-17d6-4104-982f-f365b21a42af tempest-ProjectMemberTests-605116020 None] Lock "cinder-878872d3-d8b2-4be3-9416-65fb0866a492-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (1015116f-fe6c-486b-8fae-beb952db4432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6788b06-7382-4369-a977-a5b5c0fc8e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6788b06-7382-4369-a977-a5b5c0fc8e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1012631565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:35:16Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd0dedb-dedd-41d7-9cd1-fe2a0cf234e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd0dedb-dedd-41d7-9cd1-fe2a0cf234e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa46d1f-f722-4e6e-8f97-ed6c8ecdcf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa46d1f-f722-4e6e-8f97-ed6c8ecdcf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b', 'volume_name': 'volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c368a56d-b79d-4648-af4e-5e5d67569ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c368a56d-b79d-4648-af4e-5e5d67569ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c24a3-c61c-4160-8a49-52c6e83ad722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:16 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Volume 93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b', 'volume_size': 1} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1012631565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:35:16Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Creating volume 93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:35:16 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:35:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:16 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b 1073741824 Jul 05 05:35:16 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:17 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b 1073741824" returned: 0 in 0.785s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:17 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b Jul 05 05:35:17 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:17 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b" returned: 0 in 0.674s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c24a3-c61c-4160-8a49-52c6e83ad722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02823920-7bd4-4ba1-9d50-c9a23b16ecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:35:17 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Volume volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b (93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b): created successfully Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02823920-7bd4-4ba1-9d50-c9a23b16ecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:35:17 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (1015116f-fe6c-486b-8fae-beb952db4432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:35:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9f7e6896-b547-4532-932f-f41be58098fd tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:35:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 6725772a-e040-4944-9557-fd7cd4abfa6e of volume 93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:35:18 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43b1f2-6f39-4543-bd6f-cfb8615ebd5d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:35:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:18 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b Jul 05 05:35:18 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:19 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b" returned: 0 in 0.760s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:19 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e 1G Jul 05 05:35:19 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:19 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e 1G" returned: 0 in 0.771s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:20 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e Jul 05 05:35:20 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:20 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e" returned: 0 in 0.673s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:20 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e is being set with open permissions: ugo+rw Jul 05 05:35:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:20 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e Jul 05 05:35:20 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:21 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.6725772a-e040-4944-9557-fd7cd4abfa6e" returned: 0 in 0.642s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:21 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.info Jul 05 05:35:21 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:21 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.info" returned: 0 in 0.635s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:21 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.info is being set with open permissions: ugo+rw Jul 05 05:35:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:21 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.info Jul 05 05:35:21 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:22 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-93a56c4f-8bcb-48a6-a3f1-9155d0c4d75b.info" returned: 0 in 0.635s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.191s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:22 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c571073c-abd9-4bc3-9e64-13bc9a78bc5e tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:35:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9218c4cb-1530-4466-9c66-e68db3dcfc23 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-6725772a-e040-4944-9557-fd7cd4abfa6e-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:35:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9218c4cb-1530-4466-9c66-e68db3dcfc23 tempest-ProjectMemberTests-605116020 None] Lock "cinder-6725772a-e040-4944-9557-fd7cd4abfa6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:35:23 devstack cinder-volume[86688]: INFO cinder.message.api [None req-9218c4cb-1530-4466-9c66-e68db3dcfc23 tempest-ProjectMemberTests-605116020 None] Creating message record for request_id = req-9218c4cb-1530-4466-9c66-e68db3dcfc23 Jul 05 05:35:23 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9218c4cb-1530-4466-9c66-e68db3dcfc23 tempest-ProjectMemberTests-605116020 None] Lock "cinder-6725772a-e040-4944-9557-fd7cd4abfa6e-delete_snapshot" released by "delete_snapshot" :: held 0.038s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server [None req-9218c4cb-1530-4466-9c66-e68db3dcfc23 tempest-ProjectMemberTests-605116020 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 05:35:23 devstack cinder-volume[86688]: ERROR oslo_messaging.rpc.server Jul 05 05:35:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:35:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:35:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:35:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:35:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:35:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:35:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:35:30 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:35:30 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:35:31 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 05 05:35:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.630s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:35:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:35:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:35:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:35:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:35:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=20,cinder:DELETE=3,cinder:SELECT=19,cinder:INSERT=7 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:35:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=21,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:36:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:36:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:36:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:36:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:36:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:36:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:36:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:36:30 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:36:30 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:36:31 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jul 05 05:36:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.642s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:36:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:36:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:36:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:36:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:36:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:37:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:37:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:37:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:37:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:30 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:37:30 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:31 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:37:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:37:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:37:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (9151870b-b627-4c91-85ee-73629913ff91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff143f16-4ef9-4bf4-9dd6-9b26bc4c0bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff143f16-4ef9-4bf4-9dd6-9b26bc4c0bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280141247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3595c9-5ec0-43e5-a19c-1662e8b3899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:37:38Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8feb4d28-b7a8-414d-bc2b-0b1e50c8e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8feb4d28-b7a8-414d-bc2b-0b1e50c8e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e627e37-1bc0-4ee5-9bdd-582a63278f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e627e37-1bc0-4ee5-9bdd-582a63278f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3595c9-5ec0-43e5-a19c-1662e8b3899a', 'volume_name': 'volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cdeba8-ae3d-4da9-90e3-47099d1c105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9cdeba8-ae3d-4da9-90e3-47099d1c105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9de7fac-6811-4881-8cef-570519467dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:38 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Volume df3595c9-5ec0-43e5-a19c-1662e8b3899a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a', 'volume_size': 1} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280141247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3595c9-5ec0-43e5-a19c-1662e8b3899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:37:38Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Creating volume df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:37:38 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:37:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:38 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a 1073741824 Jul 05 05:37:38 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:39 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a 1073741824" returned: 0 in 0.799s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:39 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a Jul 05 05:37:39 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:40 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a" returned: 0 in 0.633s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9de7fac-6811-4881-8cef-570519467dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fb2662-7a37-42db-a2b3-8a4da9cfbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:40 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Volume volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a (df3595c9-5ec0-43e5-a19c-1662e8b3899a): created successfully Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fb2662-7a37-42db-a2b3-8a4da9cfbf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (9151870b-b627-4c91-85ee-73629913ff91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:37:40 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-af775940-3e4b-4b7c-93c8-6102df333a75 tempest-ProjectReaderTests-1089172562 None] Created volume successfully. Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Creating offline snapshot 60c57c54-c9cc-4156-94e9-d6578ad61051 of volume df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[07817871-33b0-4f04-9b92-e6017b6c2521]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:37:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:40 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a Jul 05 05:37:40 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:41 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a" returned: 0 in 0.768s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:41 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 1G Jul 05 05:37:41 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:42 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 1G" returned: 0 in 0.783s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:42 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 Jul 05 05:37:42 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:43 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051" returned: 0 in 0.674s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:43 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 is being set with open permissions: ugo+rw Jul 05 05:37:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:43 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 Jul 05 05:37:43 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:43 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051" returned: 0 in 0.626s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:43 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.info Jul 05 05:37:43 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:44 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.info" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:44 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.info is being set with open permissions: ugo+rw Jul 05 05:37:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:44 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.info Jul 05 05:37:44 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:44 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.info" returned: 0 in 0.644s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.211s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a1bcf75a-b663-4d60-b5f9-cdb806fc2ca0 tempest-ProjectReaderTests-1089172562 None] Create snapshot completed successfully Jul 05 05:37:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-60c57c54-c9cc-4156-94e9-d6578ad61051-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Lock "cinder-60c57c54-c9cc-4156-94e9-d6578ad61051-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:45 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-df3595c9-5ec0-43e5-a19c-1662e8b3899a" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-df3595c9-5ec0-43e5-a19c-1662e8b3899a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-60c57c54-c9cc-4156-94e9-d6578ad61051" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-60c57c54-c9cc-4156-94e9-d6578ad61051" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Deleting offline snapshot 60c57c54-c9cc-4156-94e9-d6578ad61051 of volume df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] snapshot_file for this snap is: volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[158fa1e7-a1e4-4685-aec0-5f62c044e064]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:46 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 Jul 05 05:37:46 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:46 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051" returned: 0 in 0.761s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[76865335-c038-4198-9b73-3454fea70bae]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:37:46 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:46 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a Jul 05 05:37:46 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:47 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a" returned: 0 in 0.724s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:47 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 Jul 05 05:37:47 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:48 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051" returned: 0 in 0.727s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:48 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051 Jul 05 05:37:48 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:48 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a.60c57c54-c9cc-4156-94e9-d6578ad61051" returned: 0 in 0.624s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-60c57c54-c9cc-4156-94e9-d6578ad61051" released by "_delete_snapshot" :: held 2.921s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:37:48 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-df3595c9-5ec0-43e5-a19c-1662e8b3899a" released by "delete_snapshot" :: held 2.941s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Created reservations ['a615e4de-d572-4965-9e22-abef422d3d0d', 'bbffd077-92dd-42d3-8521-a89e64afe394', '1ff76c0e-4c8f-42c6-8955-7b45c3645918', '1e7026e5-480e-4cbd-aff4-a80a98030510'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:37:49 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Delete snapshot completed successfully. Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-447f9d8c-1068-4fcb-81b2-d8ce0254401b tempest-ProjectReaderTests-1089172562 None] Lock "cinder-60c57c54-c9cc-4156-94e9-d6578ad61051-delete_snapshot" released by "delete_snapshot" :: held 3.070s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-df3595c9-5ec0-43e5-a19c-1662e8b3899a-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-df3595c9-5ec0-43e5-a19c-1662e8b3899a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-df3595c9-5ec0-43e5-a19c-1662e8b3899a" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-df3595c9-5ec0-43e5-a19c-1662e8b3899a" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a9cafb-d1b5-4aa9-9099-3ee75e3780ae]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:49 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a Jul 05 05:37:49 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:49 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a" returned: 0 in 0.737s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:50 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a Jul 05 05:37:50 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:50 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-df3595c9-5ec0-43e5-a19c-1662e8b3899a" returned: 0 in 0.634s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-df3595c9-5ec0-43e5-a19c-1662e8b3899a" released by "delete_volume" :: held 1.424s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Created reservations ['26a08b50-9723-4a5c-8260-9a3c4cef80bf', 'a79a941b-0b82-4a36-b579-87c6a30612e6', 'e69596a2-25da-43d7-9629-97c2ba20aabb', '03ad20f8-ad0e-4b48-a12a-c9602aa05e83'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:50 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:37:50 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:51 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.656s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:37:51 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Deleted volume successfully. Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-628e16db-640e-43e9-a513-49224e27caa4 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-df3595c9-5ec0-43e5-a19c-1662e8b3899a-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (b9c14d3d-37c8-4a5a-9d91-4a4eb19bc5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3344fe-14c4-4d4e-bd5b-5ce89a7b3c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3344fe-14c4-4d4e-bd5b-5ce89a7b3c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260418366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e19331-ad6d-4f6c-9b72-49b9839d0ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:37:52Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc5bb6d-f184-44c9-9268-21c51b2e2c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc5bb6d-f184-44c9-9268-21c51b2e2c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1422b89-21c0-4ab5-bc66-8068dc963fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1422b89-21c0-4ab5-bc66-8068dc963fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e19331-ad6d-4f6c-9b72-49b9839d0ebc', 'volume_name': 'volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4435985-42ed-4624-80f7-a0d3d1c09076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4435985-42ed-4624-80f7-a0d3d1c09076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e788707-8b18-47b3-9b36-cabc4ac456c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:51 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Volume 17e19331-ad6d-4f6c-9b72-49b9839d0ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc', 'volume_size': 1} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-260418366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e19331-ad6d-4f6c-9b72-49b9839d0ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:37:52Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Creating volume 17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:37:51 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:37:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:51 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc 1073741824 Jul 05 05:37:51 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:52 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc 1073741824" returned: 0 in 0.808s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:52 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc Jul 05 05:37:52 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:53 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" returned: 0 in 0.634s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:53 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:37:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e788707-8b18-47b3-9b36-cabc4ac456c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2c842b-aab7-4d62-8c11-f0848ccac18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:37:53 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Volume volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc (17e19331-ad6d-4f6c-9b72-49b9839d0ebc): created successfully Jul 05 05:37:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2c842b-aab7-4d62-8c11-f0848ccac18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:37:53 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (b9c14d3d-37c8-4a5a-9d91-4a4eb19bc5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:37:53 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-3c7d6590-b89b-4145-8149-00f7eceeb828 tempest-ProjectReaderTests-1089172562 None] Created volume successfully. Jul 05 05:37:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:37:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:37:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Creating offline snapshot 738f8f9b-dcdb-4d30-b2c2-119d4af834fa of volume 17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:37:54 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ccb013-6db2-4be0-875b-91c333b6e081]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:37:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:54 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc Jul 05 05:37:54 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:54 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" returned: 0 in 0.742s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:54 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa 1G Jul 05 05:37:54 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:55 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa 1G" returned: 0 in 0.771s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:55 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa Jul 05 05:37:55 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:56 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa" returned: 0 in 0.668s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:56 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa is being set with open permissions: ugo+rw Jul 05 05:37:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:56 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa Jul 05 05:37:56 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:56 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa" returned: 0 in 0.625s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:56 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.info Jul 05 05:37:56 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:57 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.info" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:57 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.info is being set with open permissions: ugo+rw Jul 05 05:37:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:57 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.info Jul 05 05:37:57 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:37:58 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 05 05:37:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.info" returned: 0 in 0.623s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:37:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.143s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:37:58 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-7dcec8bb-1793-4353-ac6a-918f9ebe5194 tempest-ProjectReaderTests-1089172562 None] Create snapshot completed successfully Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-738f8f9b-dcdb-4d30-b2c2-119d4af834fa-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-738f8f9b-dcdb-4d30-b2c2-119d4af834fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-738f8f9b-dcdb-4d30-b2c2-119d4af834fa" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-738f8f9b-dcdb-4d30-b2c2-119d4af834fa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Deleting offline snapshot 738f8f9b-dcdb-4d30-b2c2-119d4af834fa of volume 17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] snapshot_file for this snap is: volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1791541-b022-4848-9020-1997121939fa]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:37:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:37:59 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa Jul 05 05:37:59 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:00 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa" returned: 0 in 0.744s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:38:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dfa492-d383-4664-b20d-8c21fff838dd]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:00 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc Jul 05 05:38:00 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:00 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" returned: 0 in 0.733s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:00 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa Jul 05 05:38:00 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:01 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa" returned: 0 in 0.720s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:01 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa Jul 05 05:38:01 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:02 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc.738f8f9b-dcdb-4d30-b2c2-119d4af834fa" returned: 0 in 0.628s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-738f8f9b-dcdb-4d30-b2c2-119d4af834fa" released by "_delete_snapshot" :: held 2.909s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" released by "delete_snapshot" :: held 2.930s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Created reservations ['31438ca1-7f70-4164-bb9c-336919b8a1ad', '4d761827-6eb5-4f72-820d-9a505eb2eb9b', 'dd42ac9f-8c69-424e-b4bc-d5a744281aa1', '10b1f475-e990-41f3-b8ce-f9141727e36d'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:38:02 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Delete snapshot completed successfully. Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-062b277c-b88f-4194-ab27-8f0071399613 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-738f8f9b-dcdb-4d30-b2c2-119d4af834fa-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-17e19331-ad6d-4f6c-9b72-49b9839d0ebc-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-17e19331-ad6d-4f6c-9b72-49b9839d0ebc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c59d9ba-c7f2-4f4a-980e-182e29410112]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:02 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc Jul 05 05:38:02 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:03 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" returned: 0 in 0.735s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:03 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc Jul 05 05:38:03 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:03 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" returned: 0 in 0.641s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-17e19331-ad6d-4f6c-9b72-49b9839d0ebc" released by "delete_volume" :: held 1.437s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:03 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Created reservations ['fe1badd6-82ed-4505-a249-1450dcf1f4d6', '36cbc627-d44c-4338-ad58-a9ab37fdba0c', 'd2a40af1-5f46-40be-9b8e-84fa23e80b84', '1f70dab2-1ff5-4436-810b-49e7b8bec3b5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:04 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:38:04 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:04 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.666s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:38:04 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Deleted volume successfully. Jul 05 05:38:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ed60ea23-f0c0-4083-a7ed-a84395119157 tempest-ProjectReaderTests-1089172562 None] Lock "cinder-17e19331-ad6d-4f6c-9b72-49b9839d0ebc-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (a29eef51-e92c-46bd-bf97-38e3724fdb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f14f97-5143-4671-be02-fa180f40e90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42f14f97-5143-4671-be02-fa180f40e90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-271968135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e281649-7a4a-4efa-b8cf-eb04fb0aa930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:38:05Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450536f0-1095-46f6-a85c-270ebb4d88f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450536f0-1095-46f6-a85c-270ebb4d88f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9312d0-5d77-43d2-b338-732199e8beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9312d0-5d77-43d2-b338-732199e8beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e281649-7a4a-4efa-b8cf-eb04fb0aa930', 'volume_name': 'volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cb8f19-34e3-4305-b698-f8d2bc9114ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cb8f19-34e3-4305-b698-f8d2bc9114ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02d56d6-5681-4db0-86e6-9fcf3a26f8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:05 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Volume 6e281649-7a4a-4efa-b8cf-eb04fb0aa930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930', 'volume_size': 1} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-271968135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e281649-7a4a-4efa-b8cf-eb04fb0aa930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4567f9ed7c403a855b74f0f76eed8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:38:05Z,use_quota=True,user_id='843166803975473f8d62f25ae032324e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Creating volume 6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:38:05 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:05 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 1073741824 Jul 05 05:38:05 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:05 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 1073741824" returned: 0 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:05 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 Jul 05 05:38:05 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:06 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" returned: 0 in 0.624s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:38:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02d56d6-5681-4db0-86e6-9fcf3a26f8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d866b0e2-d3ed-4928-bc36-dbbc9887929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Volume volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 (6e281649-7a4a-4efa-b8cf-eb04fb0aa930): created successfully Jul 05 05:38:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d866b0e2-d3ed-4928-bc36-dbbc9887929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Flow 'volume_create_manager' (a29eef51-e92c-46bd-bf97-38e3724fdb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:38:06 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-19bb3dcf-7fd2-4858-9233-35aae44835ff tempest-ProjectReaderTests-1089172562 None] Created volume successfully. Jul 05 05:38:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Creating offline snapshot eeb0a549-14d7-41b9-a5fa-b751fb2d944f of volume 6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:38:07 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bff6a3-fe80-4d38-bf70-96f454dfe364]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:07 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 Jul 05 05:38:07 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:07 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" returned: 0 in 0.743s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:08 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f 1G Jul 05 05:38:08 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:08 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f 1G" returned: 0 in 0.776s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:08 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f Jul 05 05:38:08 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:09 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f" returned: 0 in 0.664s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:09 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f is being set with open permissions: ugo+rw Jul 05 05:38:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:09 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f Jul 05 05:38:09 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:10 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f" returned: 0 in 0.618s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:10 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.info Jul 05 05:38:10 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:10 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.info" returned: 0 in 0.624s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:10 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.info is being set with open permissions: ugo+rw Jul 05 05:38:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:10 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.info Jul 05 05:38:10 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:11 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.info" returned: 0 in 0.630s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.134s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:11 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-f864e92f-5b5d-4c8d-898a-de382474ac8c tempest-ProjectReaderTests-1089172562 None] Create snapshot completed successfully Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-eeb0a549-14d7-41b9-a5fa-b751fb2d944f-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Lock "cinder-eeb0a549-14d7-41b9-a5fa-b751fb2d944f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-eeb0a549-14d7-41b9-a5fa-b751fb2d944f" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-eeb0a549-14d7-41b9-a5fa-b751fb2d944f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Deleting offline snapshot eeb0a549-14d7-41b9-a5fa-b751fb2d944f of volume 6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] snapshot_file for this snap is: volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb65068-bd5b-4427-99a7-bc096eda60b5]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:12 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f Jul 05 05:38:12 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:13 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f" returned: 0 in 0.743s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:38:13 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0b933b-6e5d-45d6-9f72-c96a9d6df82c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:13 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 Jul 05 05:38:13 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:14 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" returned: 0 in 0.733s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:14 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f Jul 05 05:38:14 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:14 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f" returned: 0 in 0.715s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:14 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f Jul 05 05:38:14 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:15 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930.eeb0a549-14d7-41b9-a5fa-b751fb2d944f" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-eeb0a549-14d7-41b9-a5fa-b751fb2d944f" released by "_delete_snapshot" :: held 2.921s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" released by "delete_snapshot" :: held 2.950s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Created reservations ['f93720a9-7430-4f87-bb0d-4a87bd4c7484', '5d250aa8-6da5-401c-8eae-7d2deadbb807', '0dbe982c-1334-488d-88d5-94075158b075', 'c64aef20-79c9-4bd6-8efe-c48a12fcca5e'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:38:15 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Delete snapshot completed successfully. Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-41575027-ec4f-43be-81a5-bb17acfceb8c tempest-ProjectReaderTests-1089172562 None] Lock "cinder-eeb0a549-14d7-41b9-a5fa-b751fb2d944f-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-6e281649-7a4a-4efa-b8cf-eb04fb0aa930-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Lock "cinder-6e281649-7a4a-4efa-b8cf-eb04fb0aa930-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Acquiring lock "cinder-quobyte-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4730a34-94d8-4da1-aa15-097653734189]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:15 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 Jul 05 05:38:15 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:16 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" returned: 0 in 0.753s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:16 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930 Jul 05 05:38:16 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:17 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" returned: 0 in 0.623s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Lock "cinder-quobyte-6e281649-7a4a-4efa-b8cf-eb04fb0aa930" released by "delete_volume" :: held 1.428s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Created reservations ['444c7c0a-f486-48ac-b282-72852cfc65a0', 'a7559f7f-dd67-466e-a01d-572f80ac64e2', '26277105-f83f-499f-9b7e-024b42f6ddc4', '60bc06e4-5732-4976-a274-6e6847edb5f5'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:17 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:38:17 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:17 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.626s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:38:17 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Deleted volume successfully. Jul 05 05:38:17 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-0231097b-3474-4eac-8aa5-0486634326ba tempest-ProjectReaderTests-1089172562 None] Lock "cinder-6e281649-7a4a-4efa-b8cf-eb04fb0aa930-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:38:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:38:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:38:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:30 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:38:30 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:31 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.619s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:38:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:38:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:38:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:38:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=50,cinder:SELECT=44,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:38:33 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=41,cinder:UPDATE=59,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (9e820752-b8e3-4f15-8ba5-669d7e6f14a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8dcb23-29f7-4a1e-965f-dcb400fbe29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8dcb23-29f7-4a1e-965f-dcb400fbe29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884000301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e63f45-c100-4d0c-8f55-7bcd3ace55d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:38:40Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75e0a1a-20ef-49c4-91e0-606769102ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75e0a1a-20ef-49c4-91e0-606769102ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f81dd05-a24b-4d49-904d-fc2edf689be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f81dd05-a24b-4d49-904d-fc2edf689be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e63f45-c100-4d0c-8f55-7bcd3ace55d8', 'volume_name': 'volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d742547-cb4d-42d9-a1df-bbd61fab142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d742547-cb4d-42d9-a1df-bbd61fab142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a1d482-d9ba-472c-8b98-0b0f7360c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:39 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Volume b7e63f45-c100-4d0c-8f55-7bcd3ace55d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8', 'volume_size': 1} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884000301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e63f45-c100-4d0c-8f55-7bcd3ace55d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:38:40Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Creating volume b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:38:39 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:38:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:39 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 1073741824 Jul 05 05:38:39 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:40 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 1073741824" returned: 0 in 0.805s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:40 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 Jul 05 05:38:40 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:41 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" returned: 0 in 0.636s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a1d482-d9ba-472c-8b98-0b0f7360c939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa05583c-4a21-4b0e-963e-cc334a54e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:41 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Volume volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 (b7e63f45-c100-4d0c-8f55-7bcd3ace55d8): created successfully Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa05583c-4a21-4b0e-963e-cc334a54e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (9e820752-b8e3-4f15-8ba5-669d7e6f14a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:38:41 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-1ad4c1e5-5d68-477d-97ba-974729a2a132 tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 07268809-7d93-43ed-97c5-c9060033ceb6 of volume b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b379d7d-385b-4f02-aa93-fdbc0a283050]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:41 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 Jul 05 05:38:41 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:42 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" returned: 0 in 0.739s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:42 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 1G Jul 05 05:38:42 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:43 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 1G" returned: 0 in 0.773s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:43 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 Jul 05 05:38:43 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:44 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6" returned: 0 in 0.675s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:44 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 is being set with open permissions: ugo+rw Jul 05 05:38:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:44 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 Jul 05 05:38:44 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:44 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6" returned: 0 in 0.633s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:44 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.info Jul 05 05:38:44 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:45 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.info" returned: 0 in 0.645s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:45 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.info is being set with open permissions: ugo+rw Jul 05 05:38:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:45 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.info Jul 05 05:38:45 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:45 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.info" returned: 0 in 0.631s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:45 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.168s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:46 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-33a11673-4cde-44be-a521-df2e20937e52 tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-07268809-7d93-43ed-97c5-c9060033ceb6-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Lock "cinder-07268809-7d93-43ed-97c5-c9060033ceb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-07268809-7d93-43ed-97c5-c9060033ceb6" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-07268809-7d93-43ed-97c5-c9060033ceb6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot 07268809-7d93-43ed-97c5-c9060033ceb6 of volume b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fac3d1c-82d7-4df9-b7c7-2084e6b4f33b]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:47 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 Jul 05 05:38:47 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:47 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6" returned: 0 in 0.738s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2a653-e6fd-4e55-9dce-50d9b01c3485]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:47 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:47 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 Jul 05 05:38:47 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:48 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" returned: 0 in 0.741s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:48 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:48 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 Jul 05 05:38:48 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:49 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6" returned: 0 in 0.704s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:49 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6 Jul 05 05:38:49 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:49 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:49 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8.07268809-7d93-43ed-97c5-c9060033ceb6" returned: 0 in 0.628s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-07268809-7d93-43ed-97c5-c9060033ceb6" released by "_delete_snapshot" :: held 2.897s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:49 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" released by "delete_snapshot" :: held 2.919s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Created reservations ['fd3c8c35-b0f1-4322-ab27-7e7054d0c869', '148fdc39-e734-4959-a071-9f3c942e84fc', 'b9dad983-e7d8-4c0c-88fd-03233e219cd6', '17dc80ad-9b1d-40be-b305-9be57cbe7037'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:38:50 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-84ae25a5-abaf-4fdc-93f8-94471af9936f tempest-ProjectMemberTests-605116020 None] Lock "cinder-07268809-7d93-43ed-97c5-c9060033ceb6-delete_snapshot" released by "delete_snapshot" :: held 3.044s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Lock "cinder-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" acquired by "delete_volume" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe58724-0403-4c13-a143-357b9360d929]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:50 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:50 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 Jul 05 05:38:50 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:51 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" returned: 0 in 0.722s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:51 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8 Jul 05 05:38:51 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:51 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" returned: 0 in 0.638s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8" released by "delete_volume" :: held 1.412s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Created reservations ['66e13ce5-5e71-4a2b-b5bb-9aeb9480540a', '69af69ef-6205-4648-a670-9fcd4e53c93e', 'f3b4b84c-ceea-4f35-bd59-e42c21fbeffc', '68d0cfa1-8e11-4e2c-a78b-c17bcedada85'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:51 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:51 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:38:51 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:52 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:38:52 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-14516689-77ca-49d5-aba2-36ee50e9fc32 tempest-ProjectMemberTests-605116020 None] Lock "cinder-b7e63f45-c100-4d0c-8f55-7bcd3ace55d8-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (f08ca3a9-87dc-440d-914a-405cef091e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e09cde6-0ba3-4d3c-9d23-849c09c099f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e09cde6-0ba3-4d3c-9d23-849c09c099f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850504412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b119188f-4e49-49dc-b3a7-f7e52cc57932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:38:53Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83afd72-6903-4682-b983-dfd1c98da08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83afd72-6903-4682-b983-dfd1c98da08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615c50ca-9181-4a3c-9aaa-6713cd824b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615c50ca-9181-4a3c-9aaa-6713cd824b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b119188f-4e49-49dc-b3a7-f7e52cc57932', 'volume_name': 'volume-b119188f-4e49-49dc-b3a7-f7e52cc57932', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1cd0b-9c22-4959-9324-eb53db6bc301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec1cd0b-9c22-4959-9324-eb53db6bc301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9afa7a0-363e-49f4-b405-78238208a930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:52 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Volume b119188f-4e49-49dc-b3a7-f7e52cc57932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b119188f-4e49-49dc-b3a7-f7e52cc57932', 'volume_size': 1} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850504412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b119188f-4e49-49dc-b3a7-f7e52cc57932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:38:53Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Creating volume b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:38:52 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:38:52 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:52 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 1073741824 Jul 05 05:38:52 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:53 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 1073741824" returned: 0 in 0.801s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:53 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:53 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 Jul 05 05:38:53 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:54 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932" returned: 0 in 0.631s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:54 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:38:54 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9afa7a0-363e-49f4-b405-78238208a930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b119188f-4e49-49dc-b3a7-f7e52cc57932', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111e1bbe-10b4-4b44-87f3-1a1e5ab52558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:38:54 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Volume volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 (b119188f-4e49-49dc-b3a7-f7e52cc57932): created successfully Jul 05 05:38:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111e1bbe-10b4-4b44-87f3-1a1e5ab52558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:38:54 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (f08ca3a9-87dc-440d-914a-405cef091e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:38:54 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b0e7dffd-f6c4-4569-bfb4-9d7134c7b60d tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:38:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:38:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:38:55 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 7beefadb-3d3e-4808-87ae-8dca0fd48224 of volume b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:38:55 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[52804b94-3ad6-4796-965e-c7c0edd81909]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:38:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:55 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 Jul 05 05:38:55 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:55 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932" returned: 0 in 0.743s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:55 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:55 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 1G Jul 05 05:38:55 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:56 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 1G" returned: 0 in 0.783s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:56 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:56 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 Jul 05 05:38:56 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:57 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224" returned: 0 in 0.679s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:57 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 is being set with open permissions: ugo+rw Jul 05 05:38:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:57 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 Jul 05 05:38:57 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:57 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224" returned: 0 in 0.625s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:57 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:57 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.info Jul 05 05:38:57 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:58 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.info" returned: 0 in 0.651s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:58 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.info is being set with open permissions: ugo+rw Jul 05 05:38:58 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:38:58 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.info Jul 05 05:38:58 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:38:59 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 05 05:38:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.info" returned: 0 in 0.643s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:38:59 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:38:59 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c3e713bd-6cb7-4d7b-8c1b-9a068337c0fc tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-7beefadb-3d3e-4808-87ae-8dca0fd48224-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Lock "cinder-7beefadb-3d3e-4808-87ae-8dca0fd48224-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-b119188f-4e49-49dc-b3a7-f7e52cc57932" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b119188f-4e49-49dc-b3a7-f7e52cc57932" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-7beefadb-3d3e-4808-87ae-8dca0fd48224" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-7beefadb-3d3e-4808-87ae-8dca0fd48224" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot 7beefadb-3d3e-4808-87ae-8dca0fd48224 of volume b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dbd8f9-a6b4-448f-be31-4d21081a925d]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:00 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:00 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 Jul 05 05:39:00 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:01 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224" returned: 0 in 0.720s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:01 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b119188f-4e49-49dc-b3a7-f7e52cc57932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:39:01 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45cbaf7-d7c5-4bf9-bbc8-e7d311720d27]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:01 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 Jul 05 05:39:01 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:01 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932" returned: 0 in 0.746s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:01 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:01 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 Jul 05 05:39:01 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:02 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224" returned: 0 in 0.710s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:02 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:02 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224 Jul 05 05:39:02 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:03 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932.7beefadb-3d3e-4808-87ae-8dca0fd48224" returned: 0 in 0.632s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-7beefadb-3d3e-4808-87ae-8dca0fd48224" released by "_delete_snapshot" :: held 2.891s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b119188f-4e49-49dc-b3a7-f7e52cc57932" released by "delete_snapshot" :: held 2.914s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Created reservations ['5c4db32f-db73-4e4a-bdf2-72d527dde600', '8d7bea93-9aab-4893-9d2b-1e1162dce5e7', 'cb4f9536-8adf-47f5-a846-25171f6cb467', '267ebe0a-ceac-4f07-b94d-fa239357bd62'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:03 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-d0469435-dadc-474d-ba02-39340c2a0a8f tempest-ProjectMemberTests-605116020 None] Lock "cinder-7beefadb-3d3e-4808-87ae-8dca0fd48224-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-b119188f-4e49-49dc-b3a7-f7e52cc57932-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Lock "cinder-b119188f-4e49-49dc-b3a7-f7e52cc57932-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-b119188f-4e49-49dc-b3a7-f7e52cc57932" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b119188f-4e49-49dc-b3a7-f7e52cc57932" acquired by "delete_volume" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07afa54-df3c-4f8b-a61e-3dba89e62f04]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:03 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:03 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 Jul 05 05:39:03 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:04 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932" returned: 0 in 0.756s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:04 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932 Jul 05 05:39:04 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:04 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:04 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-b119188f-4e49-49dc-b3a7-f7e52cc57932" returned: 0 in 0.634s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:04 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-b119188f-4e49-49dc-b3a7-f7e52cc57932" released by "delete_volume" :: held 1.443s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:04 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Created reservations ['0506cb03-b3fb-4854-a315-15a56f30b7fc', '2befbcbb-e672-43ab-bb72-ea9729355b1e', '9a88f5b9-30d2-43e3-9b3b-ed1021f64128', '9708c8ff-59f4-4796-9870-3f3bc3768ef9'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:05 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:39:05 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:05 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.659s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:39:05 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:39:05 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-ddfefe25-4871-4631-b420-d3a82fb15213 tempest-ProjectMemberTests-605116020 None] Lock "cinder-b119188f-4e49-49dc-b3a7-f7e52cc57932-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (114d300b-793c-4453-85e2-421fb5076831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00ace93-c5d9-4a27-9ebc-af42cdb4fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00ace93-c5d9-4a27-9ebc-af42cdb4fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121074804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f12bdc-beec-4dab-8456-af45d48bc485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:39:06Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8a87c3-1186-4038-a5a7-b12735d8b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8a87c3-1186-4038-a5a7-b12735d8b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1363dd07-c665-4d92-b286-0bc4774a29eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1363dd07-c665-4d92-b286-0bc4774a29eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f12bdc-beec-4dab-8456-af45d48bc485', 'volume_name': 'volume-e8f12bdc-beec-4dab-8456-af45d48bc485', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db18ee4c-250e-42d2-8f40-2c410f4d1c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db18ee4c-250e-42d2-8f40-2c410f4d1c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14986ddc-abda-4940-ae27-eb1b82bf7fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:06 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Volume e8f12bdc-beec-4dab-8456-af45d48bc485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f12bdc-beec-4dab-8456-af45d48bc485', 'volume_size': 1} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121074804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f12bdc-beec-4dab-8456-af45d48bc485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:39:06Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Creating volume e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:39:06 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:06 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 1073741824 Jul 05 05:39:06 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:06 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 1073741824" returned: 0 in 0.797s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:06 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:06 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 Jul 05 05:39:06 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:07 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485" returned: 0 in 0.631s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:07 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:39:07 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14986ddc-abda-4940-ae27-eb1b82bf7fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f12bdc-beec-4dab-8456-af45d48bc485', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f821dbc1-2261-4869-acb8-5a704588af8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:07 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Volume volume-e8f12bdc-beec-4dab-8456-af45d48bc485 (e8f12bdc-beec-4dab-8456-af45d48bc485): created successfully Jul 05 05:39:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f821dbc1-2261-4869-acb8-5a704588af8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:07 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (114d300b-793c-4453-85e2-421fb5076831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:39:07 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a6c33381-00bf-47f6-8d6e-fb52c7d1e3d4 tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:39:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:08 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 83f2b65c-f761-447d-8aef-4e3a04038ab0 of volume e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:39:08 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b4d4ec-8b94-412d-ad45-cba90f0a28e0]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:08 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:08 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 Jul 05 05:39:08 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:09 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485" returned: 0 in 0.729s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:09 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 1G Jul 05 05:39:09 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:09 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 1G" returned: 0 in 0.761s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:09 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f12bdc-beec-4dab-8456-af45d48bc485 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:09 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f12bdc-beec-4dab-8456-af45d48bc485 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 Jul 05 05:39:09 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:10 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f12bdc-beec-4dab-8456-af45d48bc485 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0" returned: 0 in 0.690s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:10 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 is being set with open permissions: ugo+rw Jul 05 05:39:10 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:10 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 Jul 05 05:39:10 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:11 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0" returned: 0 in 0.614s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:11 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.info Jul 05 05:39:11 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:11 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.info" returned: 0 in 0.630s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:11 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.info is being set with open permissions: ugo+rw Jul 05 05:39:11 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:11 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.info Jul 05 05:39:11 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:12 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.info" returned: 0 in 0.636s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:12 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.135s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:12 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-b28a7cdf-5a66-4e0a-b21e-2a2555c7ef16 tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-83f2b65c-f761-447d-8aef-4e3a04038ab0-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Lock "cinder-83f2b65c-f761-447d-8aef-4e3a04038ab0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-e8f12bdc-beec-4dab-8456-af45d48bc485" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-e8f12bdc-beec-4dab-8456-af45d48bc485" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-83f2b65c-f761-447d-8aef-4e3a04038ab0" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-83f2b65c-f761-447d-8aef-4e3a04038ab0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot 83f2b65c-f761-447d-8aef-4e3a04038ab0 of volume e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72efd2a-e122-4a1d-94b7-0f23c6583f83]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:13 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:13 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 Jul 05 05:39:13 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:14 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0" returned: 0 in 0.731s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:14 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f12bdc-beec-4dab-8456-af45d48bc485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:39:14 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd856fe-fc5a-4c77-b855-a6a31ab10442]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:14 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:14 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 Jul 05 05:39:14 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:15 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485" returned: 0 in 0.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:15 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 Jul 05 05:39:15 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:15 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0" returned: 0 in 0.722s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:15 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:15 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0 Jul 05 05:39:15 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:16 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485.83f2b65c-f761-447d-8aef-4e3a04038ab0" returned: 0 in 0.621s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-83f2b65c-f761-447d-8aef-4e3a04038ab0" released by "_delete_snapshot" :: held 2.902s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-e8f12bdc-beec-4dab-8456-af45d48bc485" released by "delete_snapshot" :: held 2.922s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Created reservations ['bfa18a09-b0f6-458a-9117-dcef35df2fd1', '2e209070-d7c7-4e5f-b198-5a9bb219a68b', '8ada88fe-8a08-4337-994b-52fbe3936a4e', 'c1ef9209-ee20-4cfa-be13-6ec4a1684fc3'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:16 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-09bead33-93bd-4deb-9b90-16cf9157a034 tempest-ProjectMemberTests-605116020 None] Lock "cinder-83f2b65c-f761-447d-8aef-4e3a04038ab0-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-e8f12bdc-beec-4dab-8456-af45d48bc485-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Lock "cinder-e8f12bdc-beec-4dab-8456-af45d48bc485-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-e8f12bdc-beec-4dab-8456-af45d48bc485" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-e8f12bdc-beec-4dab-8456-af45d48bc485" acquired by "delete_volume" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0ad7b-cf03-431a-914d-f2b6b11d466c]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:16 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:16 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 Jul 05 05:39:16 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:17 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485" returned: 0 in 0.721s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:17 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:17 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485 Jul 05 05:39:17 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:18 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-e8f12bdc-beec-4dab-8456-af45d48bc485" returned: 0 in 0.627s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-e8f12bdc-beec-4dab-8456-af45d48bc485" released by "delete_volume" :: held 1.406s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Created reservations ['b2e02ac0-d983-43f9-92ca-36a18b0fb455', '352ec756-52e6-446c-9d2d-e216bdf6571b', '49300791-ef2a-4316-a145-1cf9a5080e1d', '86671c63-fd24-4450-9333-3297f1c6a286'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:18 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:39:18 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:18 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.633s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:39:18 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:39:18 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-4c6b3342-691d-410c-8cff-f19cc8d0142c tempest-ProjectMemberTests-605116020 None] Lock "cinder-e8f12bdc-beec-4dab-8456-af45d48bc485-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (1b7a1344-5b9b-4c6a-be1e-585bfe381c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1968241c-c19a-4e32-9c6f-3e7d984f31dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1968241c-c19a-4e32-9c6f-3e7d984f31dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424426443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde159e8-c4ca-43ed-bf57-d677ec771641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:39:19Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b057b680-ec60-4dca-8ebf-3670c9e0aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b057b680-ec60-4dca-8ebf-3670c9e0aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602f1850-7447-453b-8185-32eba6880641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602f1850-7447-453b-8185-32eba6880641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde159e8-c4ca-43ed-bf57-d677ec771641', 'volume_name': 'volume-dde159e8-c4ca-43ed-bf57-d677ec771641', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea900b5-661f-4454-b72e-18f3fbf9186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ea900b5-661f-4454-b72e-18f3fbf9186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba73e045-65d5-426f-a8cc-75f3f28db89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:19 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Volume dde159e8-c4ca-43ed-bf57-d677ec771641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde159e8-c4ca-43ed-bf57-d677ec771641', 'volume_size': 1} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1424426443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde159e8-c4ca-43ed-bf57-d677ec771641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:39:19Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Creating volume dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:39:19 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:39:19 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:19 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 1073741824 Jul 05 05:39:19 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:20 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 1073741824" returned: 0 in 0.820s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:20 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 Jul 05 05:39:20 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:20 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641" returned: 0 in 0.623s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba73e045-65d5-426f-a8cc-75f3f28db89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde159e8-c4ca-43ed-bf57-d677ec771641', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dd4072-40b9-4b79-a838-96348c5f6331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:20 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Volume volume-dde159e8-c4ca-43ed-bf57-d677ec771641 (dde159e8-c4ca-43ed-bf57-d677ec771641): created successfully Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dd4072-40b9-4b79-a838-96348c5f6331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:20 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (1b7a1344-5b9b-4c6a-be1e-585bfe381c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:39:20 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a40b3104-b116-4829-a1cd-bfd404448ae3 tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:39:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:21 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 89416f72-5822-4551-8ce8-42b10de3eb95 of volume dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:39:21 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e524a-3364-4718-995e-310c5c9c7be9]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:21 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:21 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 Jul 05 05:39:21 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:22 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641" returned: 0 in 0.735s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:22 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:22 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 1G Jul 05 05:39:22 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:23 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 1G" returned: 0 in 0.780s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde159e8-c4ca-43ed-bf57-d677ec771641 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:23 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde159e8-c4ca-43ed-bf57-d677ec771641 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 Jul 05 05:39:23 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:23 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde159e8-c4ca-43ed-bf57-d677ec771641 -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95" returned: 0 in 0.681s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:23 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 is being set with open permissions: ugo+rw Jul 05 05:39:23 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:23 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 Jul 05 05:39:23 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:24 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95" returned: 0 in 0.646s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:24 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:24 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.info Jul 05 05:39:24 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:25 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.info" returned: 0 in 0.632s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:25 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.info is being set with open permissions: ugo+rw Jul 05 05:39:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:25 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.info Jul 05 05:39:25 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:25 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.info" returned: 0 in 0.638s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.189s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:25 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-45b07781-af59-4f00-9b6f-00b547e02580 tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-89416f72-5822-4551-8ce8-42b10de3eb95-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Lock "cinder-89416f72-5822-4551-8ce8-42b10de3eb95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-dde159e8-c4ca-43ed-bf57-d677ec771641" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-dde159e8-c4ca-43ed-bf57-d677ec771641" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-89416f72-5822-4551-8ce8-42b10de3eb95" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-89416f72-5822-4551-8ce8-42b10de3eb95" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot 89416f72-5822-4551-8ce8-42b10de3eb95 of volume dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0315922-9268-4e15-82f6-cde2415ee1ee]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:26 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 Jul 05 05:39:26 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:26 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95" returned: 0 in 0.742s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde159e8-c4ca-43ed-bf57-d677ec771641(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc321f7d-1301-467f-8557-8cbe820bfb5f]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:26 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 Jul 05 05:39:26 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:27 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641" returned: 0 in 0.737s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:27 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:27 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 Jul 05 05:39:27 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:28 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95" returned: 0 in 0.732s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:28 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95 Jul 05 05:39:28 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:28 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:28 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641.89416f72-5822-4551-8ce8-42b10de3eb95" returned: 0 in 0.630s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-89416f72-5822-4551-8ce8-42b10de3eb95" released by "_delete_snapshot" :: held 2.926s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:28 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-dde159e8-c4ca-43ed-bf57-d677ec771641" released by "delete_snapshot" :: held 2.948s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Created reservations ['e95e06fd-74c5-40e3-9109-dec46d04f95e', '3624b46a-89ad-47f0-b649-ac67e4d7cc44', 'be6d369e-61d1-484a-9ba3-dc9513b3ddb5', 'e200a281-4785-4e2c-bd40-dfda5f63ff8f'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:29 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-9563528d-4e91-4b56-b79a-5a0f2719a445 tempest-ProjectMemberTests-605116020 None] Lock "cinder-89416f72-5822-4551-8ce8-42b10de3eb95-delete_snapshot" released by "delete_snapshot" :: held 3.076s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-dde159e8-c4ca-43ed-bf57-d677ec771641-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Lock "cinder-dde159e8-c4ca-43ed-bf57-d677ec771641-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-dde159e8-c4ca-43ed-bf57-d677ec771641" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-dde159e8-c4ca-43ed-bf57-d677ec771641" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f214c76-08a5-468e-9436-26622571bfad]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:29 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:29 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 Jul 05 05:39:29 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:30 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641" returned: 0 in 0.729s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:30 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641 Jul 05 05:39:30 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:30 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:39:30 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:30 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-dde159e8-c4ca-43ed-bf57-d677ec771641" returned: 0 in 0.639s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-dde159e8-c4ca-43ed-bf57-d677ec771641" released by "delete_volume" :: held 1.421s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Created reservations ['2094327b-210f-42eb-8b1b-ca988c29b6cd', '6d0eb497-68fd-4756-aeb0-c1ded5852fe1', 'baf9aba6-09e7-458d-ad74-75ea915307ca', '26afab52-be4a-49af-9edb-46f864727618'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:30 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:39:30 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:31 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.659s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_service.periodic_task [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] Running periodic task VolumeManager._thread_info {{(pid=86688) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread count: 28 {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-0fb8353b-a7db-40ad-921e-41ff77806957 None None] thread info: [<_MainThread(MainThread, started 124498720931968)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86688) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 05:39:31 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.653s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:39:31 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-a57fb634-e758-4267-a2f9-a7a334762b5e tempest-ProjectMemberTests-605116020 None] Lock "cinder-dde159e8-c4ca-43ed-bf57-d677ec771641-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (0cef88af-9bea-433b-b540-a57568b74dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f538108-fc79-4096-b553-d155e9b6bef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f538108-fc79-4096-b553-d155e9b6bef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269276635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a30def-bd7c-4a05-8c64-c140b378d18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:39:32Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e453001-3938-4add-92fe-7f23c26118ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e453001-3938-4add-92fe-7f23c26118ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb10ebf-4d6c-4004-a532-457c00aaf379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb10ebf-4d6c-4004-a532-457c00aaf379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a30def-bd7c-4a05-8c64-c140b378d18a', 'volume_name': 'volume-f8a30def-bd7c-4a05-8c64-c140b378d18a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286d0a6-87b5-4a8e-9275-e60829e36357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a286d0a6-87b5-4a8e-9275-e60829e36357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5c886b-3c84-4046-8087-71338ffe2848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:31 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Volume f8a30def-bd7c-4a05-8c64-c140b378d18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a30def-bd7c-4a05-8c64-c140b378d18a', 'volume_size': 1} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T03:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269276635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a30def-bd7c-4a05-8c64-c140b378d18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a9e9691f15436ebf022356b656ad59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T03:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T03:39:32Z,use_quota=True,user_id='295660749692454ab391902ab53e2c56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca47b236-7868-41e2-83b4-afa017a39eea),volume_type_id=ca47b236-7868-41e2-83b4-afa017a39eea)}" {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Creating volume f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Selected osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 as target Quobyte volume. {{(pid=86688) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 05:39:31 devstack cinder-volume[86688]: INFO cinder.volume.drivers.remotefs [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] casted to osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64 Jul 05 05:39:31 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a 1073741824 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:31 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a 1073741824 Jul 05 05:39:31 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:32 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a 1073741824" returned: 0 in 0.798s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:32 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:32 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a Jul 05 05:39:32 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:33 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a" returned: 0 in 0.653s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:33 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'} {{(pid=86688) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 05:39:33 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5c886b-3c84-4046-8087-71338ffe2848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a30def-bd7c-4a05-8c64-c140b378d18a', 'volume_size': 1}' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da881e8d-3c7a-439b-ab26-67442fd9bba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 05:39:33 devstack cinder-volume[86688]: INFO cinder.volume.flows.manager.create_volume [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Volume volume-f8a30def-bd7c-4a05-8c64-c140b378d18a (f8a30def-bd7c-4a05-8c64-c140b378d18a): created successfully Jul 05 05:39:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da881e8d-3c7a-439b-ab26-67442fd9bba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86688) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 05:39:33 devstack cinder-volume[86688]: DEBUG cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Flow 'volume_create_manager' (0cef88af-9bea-433b-b540-a57568b74dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86688) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 05:39:33 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c6952954-688e-4ee8-b1e0-55d326586ddb tempest-ProjectMemberTests-605116020 None] Created volume successfully. Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=58,cinder:INSERT=20,cinder:UPDATE=81,cinder:DELETE=8 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=70,cinder:SELECT=59,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Creating offline snapshot 47d91593-c038-44e1-9b40-806f51778c84 of volume f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4542b3-9a39-4a43-9e18-f8bd7730997e]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:34 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a Jul 05 05:39:34 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:34 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a" returned: 0 in 0.740s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 1G {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:34 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 1G Jul 05 05:39:34 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:35 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 1G" returned: 0 in 0.784s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:35 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8a30def-bd7c-4a05-8c64-c140b378d18a -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:35 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8a30def-bd7c-4a05-8c64-c140b378d18a -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 Jul 05 05:39:35 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:36 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8a30def-bd7c-4a05-8c64-c140b378d18a -F qcow2 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84" returned: 0 in 0.695s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:36 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 is being set with open permissions: ugo+rw Jul 05 05:39:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:36 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 Jul 05 05:39:36 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:36 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84" returned: 0 in 0.624s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:36 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:36 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.info Jul 05 05:39:36 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:37 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.info" returned: 0 in 0.637s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:37 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.remotefs [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.info is being set with open permissions: ugo+rw Jul 05 05:39:37 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.info {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:37 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.info Jul 05 05:39:37 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:38 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.info" returned: 0 in 0.624s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:38 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:38 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-c30a1ae0-d632-4262-bfcb-22e50c587478 tempest-ProjectMemberTests-605116020 None] Create snapshot completed successfully Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-47d91593-c038-44e1-9b40-806f51778c84-delete_snapshot" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Lock "cinder-47d91593-c038-44e1-9b40-806f51778c84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-f8a30def-bd7c-4a05-8c64-c140b378d18a" by "delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f8a30def-bd7c-4a05-8c64-c140b378d18a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-47d91593-c038-44e1-9b40-806f51778c84" by "_delete_snapshot" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-47d91593-c038-44e1-9b40-806f51778c84" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Deleting offline snapshot 47d91593-c038-44e1-9b40-806f51778c84 of volume f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] snapshot_file for this snap is: volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 {{(pid=86688) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da72d9-8957-4ed0-8397-0171006b5c7a]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:39 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:39 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 Jul 05 05:39:39 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:40 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84" returned: 0 in 0.734s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:40 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8a30def-bd7c-4a05-8c64-c140b378d18a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86688) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 05:39:40 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f60ad4d-c564-4ace-8027-0fa0d9b381ff]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:40 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a Jul 05 05:39:40 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:40 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a" returned: 0 in 0.738s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:40 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:40 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 Jul 05 05:39:40 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:41 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84" returned: 0 in 0.745s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:41 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:41 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84 Jul 05 05:39:41 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:42 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a.47d91593-c038-44e1-9b40-806f51778c84" returned: 0 in 0.634s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-47d91593-c038-44e1-9b40-806f51778c84" released by "_delete_snapshot" :: held 2.938s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f8a30def-bd7c-4a05-8c64-c140b378d18a" released by "delete_snapshot" :: held 2.959s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Created reservations ['5449c556-03b4-438d-84ed-a3b416089a05', '4d5aff87-7ef6-422d-b45b-7d7f0806f612', '9f4158ec-b349-47ed-adba-fe95d261eefd', '833abe87-f792-4f05-b13e-b8dc324d96df'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:42 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Delete snapshot completed successfully. Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-bda4e2cf-b43d-4a74-97ec-ee2002ea215f tempest-ProjectMemberTests-605116020 None] Lock "cinder-47d91593-c038-44e1-9b40-806f51778c84-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-f8a30def-bd7c-4a05-8c64-c140b378d18a-delete_volume" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Lock "cinder-f8a30def-bd7c-4a05-8c64-c140b378d18a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Acquiring lock "cinder-quobyte-f8a30def-bd7c-4a05-8c64-c140b378d18a" by "delete_volume" {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f8a30def-bd7c-4a05-8c64-c140b378d18a" acquired by "delete_volume" :: waited 0.014s {{(pid=86688) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG oslo.privsep.daemon [-] privsep: reply[221940b3-faaf-4d88-993c-4c446ace5eb2]: (4, 'qcow2') {{(pid=87812) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 05:39:42 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:42 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a Jul 05 05:39:42 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:43 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a" returned: 0 in 0.742s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:43 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a Jul 05 05:39:43 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:43 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:43 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f/volume-f8a30def-bd7c-4a05-8c64-c140b378d18a" returned: 0 in 0.627s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Lock "cinder-quobyte-f8a30def-bd7c-4a05-8c64-c140b378d18a" released by "delete_volume" :: held 1.426s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG cinder.quota [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Created reservations ['5b521ca9-aec0-4226-8e81-b462253cab06', 'a7063a9c-e3d4-4a49-a0cd-6c917530f202', 'c7b6c5d3-33db-481f-a482-bcb3e8ea4292', '8193476f-eb5b-4263-9f5e-069de546c5f4'] {{(pid=86688) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e881f6e-59d3-4686-8cc6-1ec677f7be64'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 05:39:44 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f Jul 05 05:39:44 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 05:39:44 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/361b023276b198f9e01d26bce3e6863f" returned: 0 in 0.629s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 05:39:44 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Deleted volume successfully. Jul 05 05:39:44 devstack cinder-volume[86688]: DEBUG cinder.coordination [None req-80b38a50-f537-49a9-9547-f1931a9923f1 tempest-ProjectMemberTests-605116020 None] Lock "cinder-f8a30def-bd7c-4a05-8c64-c140b378d18a-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=86688) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 05:39:54 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=15 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 05:39:54 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writing DB stats cinder:UPDATE=14,cinder:SELECT=10,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}